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It  is  commonly  assumed  that  student  ratings  of  college 
teaching  reflect  the  quality  of  the  teacher's  instructional 
performance.  In  contrast,  this  study  assumed  that  such 


ratings  axe,  xn  large  pari 


. , a reflectxon  of  xdiosyncratxc 


student  satisfaction  with  the  instructor's  leadership  be- 
havior . 

The  small  group  theory  advanced  by  Stogdill  (in  Leader 
Behavior  and  Group  Achievement)  suggests  that  member  satis- 
faction with  an  aspect  of  group  experience  results  when  the 
group  members ' expectations  for  that  particular  aspect  of 
the  group  experience  are  fulfilled.  In  consonance  with 
Stogdill 's  position,  this  study  hypothesized  that  a member 
of  a classroom  group  experiences  satisfaction  with  his 
teacher's  instructional  behavior  (as  measured  by  student 
ratings  of  instruction)  in  proportion  to  the  extent  that  his 
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expectations  for  the  teacher's  leadership  behavior  (a 
primary  component  of  instructional  behavior)  are  fulfilled. 

Fulfillment  of  student  expectations  for  teacher  leader- 
ship was  defined  as  the  within  factor  regressed  difference 
between  pre-class  (expected  teacher  behavior)  and  post-class 
(observed  teacher  behavior)  forms  of  an  appropriately  modi- 
fied Leader  Behavior  Description  Questionnaire  (an  instrument 
composed  primarily  of  two  factors — "initiating  structure"  and 
"consideration") . Student  ratings  of  college  teaching  were 
defined  in  terms  of  two  student  evaluation  of  teaching  instru- 
ments which  are  in  current  use  at  the  University  of  Florida. 

The  relationships  between  the  set  of  predictor  variables  (ful- 
fillment of  expectations  for  teacher  leadership)  and  the  set  of 
criterion  variables  (student  ratings  of  instruction)  were  speci- 
fied in  terms  of  canonical  correlation  coefficients. 

in  general,  the  hypotheses  of  the  study  received  only 
limited  support.  Significant  canonical  correlations  between 
the  set  of  fulfillment  of  expectations  for  teacher  leadership 
variables  and  the  set  of  student  ratings  of  instruction  vari- 
ables were  found  in  eight  of  the  thirteen  largest  classes  ob- 
served (only  thirteen  of  the  twenty-two  classes  observed  were 
large  enough  to  permit  the  use  of  a canonical  correlation 
program) . Also,  a significant  canonical  correlation  of  .63 
was  found  between  the  two  sets  of  variables  when  all 
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twenty-two  classes  (347  students)  were  treated  as  one  group. 

These  results  seemed  to  indicate  that,  as  suggested  by 
Stogdill's  theory,  a significant  portion  of  the  variance 
in  the  student  rating  of  instruction  variables  could  be 
accounted  for  by  the  fulfillment  of  expectation  for  teacher 

i 

leadership  predictors. 

Unfortunately,  however,  part  of  the  variance  within  the 
"regressed  difference"  score  predictors  was  contributed  by 
the  post-test,  and  the  post-test  was  completed  by  the  students 
on  the  same  day  as  the  student  ratings  of  instruction.  Thus, 
there  was  a question  whether  student  responses  on  both  the 
post-test  and  the  student  ratings  (responses  which  were 

f 

substantially  correlated  with  each  other)  were  the  result 
of  the  same  response  set. 

In  order  to  control  for  this  possibility,  the  regressed 
difference  scores  were  recalculated  using  class  mean  post- 
test scores.  In  other  words,  the  regressed  difference 
scores  which  were  originally  calculated  on  the  basis  of 
the  difference  between  each  student's  pre-test  and  post-test 
scores  were  recalculated  on  the  basis  of  the  difference  be- 
tween each  student's  pre-test  score  and  the  mean  post-test  score 
of  his  class.  The  effect  of  this  revised  procedure  was  to  elimi- 
nate from  the  fulfillment  of  expectations  difference-scores, 
all  of  the  post-test  variance. 
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The  canonical  correlations  betv/een  these  modified 


regressed  difference  scores  and  the  student  ratings  of 
instruction  were  not  significant  in  any  of  the  thirteen 
largest  classes.  V7ithin  the  group  of  all  classes  treated 
as  a whole,  two  statistically  significant  roots  (.01  level) 
were  found.  However,  their  size  (.20  and  .14)  suggested 
that  they  were  of  limited  practical  significance. 

The  limitations  of  the  results  and  suggestions  for 
future  research  were  discussed  at  length. 
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CHAPTER  I 


INTRODUCTION 

Need  for  the  Study 

Student  ratings  of  college  teaching  have  been  a subject 
of  interest  to  educational  researchers  for  over  forty  years. 
Investigators  in  the  area  of  teacher  effectiveness  have 
found  the  topic  one  of  particular  concern.  Their  numerous 
studies,  however,  have  produced  inconclusive  results  (Gustad, 
1967) . For  example.  Gage  (1961)  and  Lovell  and  Haner  (1955) 
have  reported  that  instructors  of  required  courses  tend  to 
receive  lower  student  ratings  of  instruction  than  do  instruc- 
tors of  elective  courses.  in  contrast,  Heilman  and  Armentrout 
(1936)  have  reported  that  there  are  no  differences  between 
the  ratings  given  by  students  taking  elective  courses  and 
those  taking  required  courses.  As  another  example,  Russell 
(1951)  and  Russell  and  Bendig  (1953)  have  reported  that 
. overachievers  tend  to  give  higher  student  ratings  of  instruc- 
tion than  do  underachievers  while  Remmers  and  Elliott  (1949) 
have  reported  no  differences  between  the  ratings  given  by 
these  two  groups.  Yet  another  example  is  found  in  the  studies 
of  expected  student  grades  and  student  ratings  of  instruction. 
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Bendig  (1953),  Blura  (1936),  Cohen  and  Humphreys  (1960), 

Eckert  (1950) , Garverick  and  Carter  (1962) , Guthrie  (1949, 
1954) , Heilman  and  Armentrout  (1936) , Hudelson  (1951) , 

Remmers  (1928,  1930,  1939,  1960),  Russell  (1951),  and  Voeks 
and  French  (1960)  have  found  no  significant  relationship 
between  expected  student  grades  and  student  ratings  of  in- 
struction. In  contrast,  Anikeef  (1953)  , Caffrey  (1.969)  , 
Echandia  (1964),  Elliott  (1950),  Rayder  (1968),  Rubenstein 
and  Mitchell  (1970),  Russell  and  Bendig  (1953),  Tref finger 
and  Feldhusen  (1970),  Walker  (1969),  and  Weaver  (1960)  have 
reported  significant  positive  correlations  between  expected 
student  grades  and  student  ratings. 

in  spite  of  this  ambiguous  evidence,  there  has  been  a 
continuing  use  of  these  instruments  in  the  evaluation  of 
faculty  teaching  competence.  At  least  two  competing  in- 
fluences have  been  responsible  for  this  inconsistency.  Firsi., 
there  has  been  apparently  no  way  for  faculty  members  and 
academic  administrators  to  evaluate  their  colleagues  without 
at  least  indirectly  questioning  their  colleagues'  profes- 
sional competence — a stimulus  toward  the  avoidance  of  student 
ratings.  Second,  in  recent  years  there  have  been  widespread 
demands  by  students,  concerned  educators,  state  legislators, 
and  other  interested  parties  for  more  effective  evaluation 
of  faculty  teaching  performance — a stimulus  toward  the  use 
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of  student  ratings.  Thus,  it  seems  likely  that  student 
ratings  have  continued  to  be  used,  if  for  no  other  reason, 
because  they  have  offered  a convenient  resolution  of  these 
competing  forces.  Student  ratings  have  evaluated  teaching 
well  enough  to  placate  those  parties  demanding  evaluation 
but  not  well  enough  to  bring  the  professional  competence 
of  faculty  members  into  serious  question. 

Since,  for  the  foregoing  and  other  reasons,  it  appears 
likely  that  student  ratings  of  college  teaching  will  continue 
to  be  used,  this  study  has  been  contrived  with  the  aim  of 
bringing  about  some  clarification  of  their  meaning  and  of 
suggesting  their  proper  function  in  the  evaluation  of  college 

teaching - 

Theoretical  Orientation 

The  theoretical  orientation  of  this  investigation  was 
drawn  from  Ralph  Stogdill's  individual  behavior  and  groj^_ 
achievement  (1959).  Stogdill's  work  is  a general  theory  of 
task  group  interaction  which  attempts  to  consolidate  a great 
number  of  empirical  findings  and  smaller  group  interaction 
theories  into  an  integrated  theory  of  organizational  achieve- 
ment. Because  it  deals  with  a vast  range  of  group  variables, 
most  of  which  are  beyond  the  scope  of  this  paper,  a full 
explication  of  his  position  is  not  made.  Instead,  only  its 
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unique  features,  those  on  which  the  hypotheses  of  this 
dissertation  were  based,  are  discussed.  The  reader  desiring 
a discussion  of  the  complete  theory  is  referred  to  Stogdill 
(1959) . 

The  feature  of  Stogdill 's  theory  which  found  applica- 
tion in  the  present  study  deals  with  the  realtionship  between 
group  member  expectations  and  group  member  satisfaction. 

In  brief,  Stogdill 's  theory  maintains  that  the  fulfillment 
of  group  member  expectations  leads  to  group  member  satis- 
faction. But  it  does  so  with  fulfillment  of  member  expecta- 
tions defined  in  a unique  way.  Fulfillment  of  a member's 
expectations  is  defined  as  the  degree  of  congruence  between 
his  expectations  for  given  aspects  of  the  group  experience 
and  his  perceptions  of  the  actual  occurrence  of  those  same 
aspects  of  the  group  experience.  What  is  unique  is  Stogdill 's 
explicit  demarcation  between  the  expectational  characteristics 
(or,  simply,  expectations)  of  the  individual  and  the  in- 
dividual's perception  of  what  occurs  in  the  group.  This 
separation  makes  possible  the  use  of  member  expectations  for 
the  group  experience  and  member  perceptions  of  the  group 
experience  as  relatively  distinct  variables  which  interact 
to  produce  member  satisfaction.  Thus,  Stogdill 's  theory 
presents  a scheme  within  which  it  is  theoretically  possible 
to  predict  member  satisfaction  from  the  observation  of  these 
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two  variables.  This  type  of  prediction  was  the  aira  of  this 
study. 

Stogdill  points  out  that  the  relationship  between 
expectations  and  satisfaction  is  not  direct  and  uncomplicated. 
This  situation  is  due,  in  no  small  part,  to  the  fact  that 
member  satisfaction  is  a global  term.  Depending  on  the 
member  and  the  type  of  group,  its  elements,  for  example, 
can  include  satisfaction  with  work,  satisfaction  with  finan- 
cial remuneration,  satisfaction  with  working  conditions, 
satisfaction  with  co-workers,  satisfaction  with  leadership, 
and  satisfaction  with  myriad  other  aspects  of  the  group 
participation  experience.  As  a consequence,  it  must  be 
understood  that  any  empirical  verification  of  the  general 
relationship  between  fulfillment  of  expectations  and  member 
satisfaction  must,  in  practice,  be  limited  to  the  examina- 
tion of  relationships  between  variables  which  share  common 
areas  of  experience.  For  example,  it  is  likely  that  member 
satisfaction  regarding  working  hours  would  be  strongly 
related  to  fulfillment  of  member  expectations  regarding 
working  hours.  It  would  be  unlikely,  however,  for  satis- 
faction regarding  working  hours  to  be  strongly  related  to 
fulfillment  of  member  expectations  for  co-v;orker  cooperation. 

One  other  limitation  in  the  general  relationship  between 
fulfillment  of  expectations  and  satisfaction  concerns  the 


member's  estimate  of  the  probability  of  having  his  expecta- 
tions fulfilled.  If  a group  member  feels  that  his  expecta- 
tions have  little  chance  of  being  fulfilled,  his  dissatis- 
faction upon  lack  of  fulfillment  will  be  less  than  it  would 
have  been  had  he  strongly  believed  that  they  would  be  ful- 
filled. Thus,  investigators  who  attempt  to  observe  the 
general  relationship  are  likely  to  detect  a strong  correla- 
tion only  if  steps  have  been  taken  to  insure  that  such  low 
probability  expectations  are  excluded  from  consideration. 

The  problem  in  Terms  of  the  Theory 

McKeachie,  Lin,  and  Mann  (1971)  have  suggested  that  a 
primary  reason  for  their  findings  of  lev/  correlations  be- 
tween student  ratings  of  instruction  and  student  achieve- 
ment is  that  there  can  be  wide  differences  among  students, 
and  between  students  and  instructors,  as  to  the  relative 
value  of  various  processes  and  goals  of  instruction.  Thus, 
modes  of  instruction  which  would  help  some  students  achieve 
their  personal  goals  may  not  be  helpful  to  others,  and  mode 
of  instruction  which  would  help  most  students  achieve  the 
instructor's  goals  may  not  be  useful  to  all  students  in 
achieving  their  personal  goals.  Translated  into  the  terms 
of  Stogdill's  theory,  McKeachie,  Lin,  and  Mann  seem  to  be 
suggesting  that  students  rate  the  quality  of  instruction  on 
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the  basis  of  whether  their  personal  and  idiosyncratic  ex- 
pectations for  the  classroom  experience  are  being  fulfilled. 

In  accordance  with  their  suggestion,  this  study  con- 
strued student  ratings  of  instruction  to  be  a function  of 
varying  student  characteristics  and  it  sought  to  understand 
the  relationship  betwem  student  ratings  of  instruction  and 
student  characteristics  by  conceptualizing  the  problem  in 
terms  of  Stogdill's  theory.  Specifically,  student  ratings 
of  college  teaching  were  regarded  as  an  index  of  student 
satisfaction  with  the  classroom  leadership  behavior  of  the 
instructor.  And,  in  keeping  with  Stogdill's  theory,  it  was 
hypothesized  that  high  student  ratings  are  a product  of  the 
fulfillment  of  student  expectations  for  the  instructor's 
classroom  leadership  behavior. 

It  should  be  noted  that  this  conception  of  the  problem 
differs  from  previous  approaches  in  at  least  one  significant 
regard.  As  is  discussed  below  in  Chapter  II,  a prepon- 
derance of  the  relevant  previous  studies  have  attempted 
to  predict  student  ratings  of  instruction  with  student 
characteristics  alone.  This  study  differs  in  that  it  has 
attempted  to  predict  student  ratings  with  a variable,  ful- 
fillment of  member  expectations,  which  is  defined  in  terms 
of  the  interaction  between  teacher  behavior  and  student 


characteristics . 
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Expectations  for  and  perceptions  of  group  experience, 
the  interactions  of  which  were  used  by  this  study  as 
predictors,  are,  as  required  by  Stogdill's  theory,  con- 
sidered to  be  within  the  same  area  of  group  experience 
as  student  ratings  of  college  teaching.  Since,  as  stipu- 
lated above,  student  ratings  were  regarded  as  an  index 
of  student  satisfaction  with  the  instructor’s  classroom 
leadership  behavior,  the  measures  of  both  student  expecta- 
tions and  perceived  teacher  behavior  were  designed  to 
sample  the  same  area  of  group  experience--that  of  group 
leadership. 

The  theoretical  limitation  v/hich  holds  that  only 

i 

those  expectations  which  do  not  have  a low  probability  of 
fulfillment  are  related  to  satisfaction  was  dealt  with  in 
two  ways.  First,  the  instructions  of  the  student  expecta- 
tions instrument  were  worded  to  encourage  students  to  report 
realistic,  as  opposed  to  idealistic,  expectations  for 
teacher  behavior  (see  Appendix  B) . Second,  as  will  be  ex- 
plained in  greater  detail  below,  the  expectations  instru- 
ment was  composed  of  items  which  tap  areas  of  demonstrated 
importance  in  leader  behavior.  Therefore,  it  was  assumed 
that  at  least  enough  of  the  items  would  be  of  a sufficiently 
high  probability  to  significantly  affect  the  sum  of  the 


items  within  each  factor. 
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Scope  of  This  Study 

This  study  attempted  to  bring  about  some  clarification 
of  student  ratings  of  college  teaching  by  translating  the 
question  of  their  meaning  into  the  terms  of  a theory  of 
small  group  behavior.  Two  relevant  concomitants  of  student 
ratings  were  identified,  the  relationships  between  them  were 
defined  in  terms  of  Stodgill's  theory,  and  the  hypothesized 
relationships  between  these  variables  and  the  student  ratings 
were  empirically  tested.  It  was  intended  that  confirmation 
of  the  theory's  predictions  would  lend  support  to  the  partic- 
ular construction  of  the  problem  made  by  the  theory  and 
would  further  serve  as  an  argument  for  the  use  of  the  theory 
in  the  analysis  of  other  problems  involving  other  classroom 
interactions.  It  was  also  intended  that  confirmation  of 
the  theory's  predictions  would  also  serve  as  partial  evidence 
of  the  construct  validity  of  the  student  ratings. 

Specifically,  this  study  undertook  the  following  tasks: 

1.  With  the  aid  of  Stogdill's  small  group  theory, 
it  delineateated  the  relationship  between  two 
student  characteristics  and  two  aspects  of 
teacher  behavior; 

2.  Through  the  use  of  these  theoretically  designated 
predictor  variables,  it  attempted  to  predict  the 
variation  in  student  ratings  within  classes  and 
among  classes. 


CHAPTER  II 


REVIEW  OF  RELATED  LITERATURE 


The  extensive  body  of  literature  dealing  with  the 
construction,  validation,  and  application  of  student  rat- 
ings of  college  teaching  has  been  recently  compiled  (Decem- 
ber, 1971)  in  an  exhaustive  review  by  Costin,  Greenough, 
and  Menges  (1971) . Much  of  the  present  review  is  based  on 
that  exposition. 

The  portion  of  the  literature  dealing  with  student 
ratings  of  instruction  which  is  relevant  to  the  pi esent 
study  is  that  comprised  of  the  several  attempts  to  validate 
student  ratings  of  instruction  by  correlating  them  with 
student  characteristics,  teacher  characteristics,  and  mis- 
cellaneous other  variables.  It  is  within  the  limited  con- 
text of  these  studies  that  the  present  investigation  may 
be  most  clearly  understood. 

The  preponderance  of  studies  attempting  to  validate 
student  ratings  of  instruction  have  treated  student  ratings 
of  instruction  as  chronologically  subsequent  reflections  of 
teacher  or  student  characteristics.  Of  this  group  of 
studies,  about  half  have  used  teacher  characteristics  as 
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predictors  and  the  other  half  have  used  student  characteris- 
tics as  predictors.  In  contrast  to  these  previous  studies, 
the  present  study  used  the  interaction  of  student-observed 
teacher  behavior  and  student  characteristics  as  a predictor 
of  student  ratings.  In  this  respect,  the  present  study  is 
unlike  any  of  the  previous  studies. 

Because  there  are  no  studies  v/hich  directly  anticipate 
the  hypotheses  of  the  present  paper,  the  literature  re- 
viewed was  selected  on  the  basis  of  its  relevance  to  the 
broad  question  of  how  student  characteristics  have  been 
found  to  be  related  to  student  ratings  of  instruction.  It 
should  be  noted,  however,  that  since  the  literature  related 
to  this  broad  topic  went  well  beyond  the  scope  'of  Liie  pre- 
sent hypotheses,  this  reviev/  was  limited  to  a summation  of 
this  extensive  material.  Rather  than  offering  a detailed 
discussion  of  the  available  literature,  this  review  was 
intended  as  an  overview  which  would  convey  to  the  reader 
the  flavor  of  the  reported  findings. 

Related  Literature 

Numerous  studies  have  reported  on  the  relationships 
between  student  ratings  of  instruction  and  various  student 
demographic  characteristics.  Classifying  student  ratings 
on  the  basis  of  the  respondents'  sex,  numerous  investigators 
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have  found  no  significant  differences  between  males  and 
females  in  several  types  of  ratings  (Bendig,  1953;  Caffrey, 
1969;  Downie,  1952;  Elliott,  1950;  Heilman  and  Armentrout, 
1936;  Lovell  and  Haner,  1955;  Remraers,  1939).  There  is, 
however,  some  evidence  of  interaction  between  the  sex  of 
the  student  rater  and  the  sex  of  the  instructor.  Both 
Walker  (1969)  and  Bendig  (1952)  have  found  that  female 
students  are  inclined  to  differentiate  between  male  and 
female  instructors,  with  female  instructors  as  the  bene-  ^ 
ficiaries  of  their  preferences. 

Another  traditional  comparison  is  that  of  graduate 
versus  undergraduate  students.  Guthrie  (1954),  Heilman  and 
Armentrout  (1936),  Stewart  and  Malpass  (1966),  and  Rayder 
(1968)  have  found  in  the  ratings  given  by  students  of 'graduate 
and  undergraduate  classifications.  In  contrast,  Remmers  and 
Elliott  (1949)  have  found  that  graduate  students  assigned 
higher  ratings  than  do  undergraduate  students.  Also,  several 
investigators  have  found  that  upper  division  undergraduate 
students  tend  to  give  higher  ratings  than  do  lower  division 
undergraduate  students  (Clark  and  Keller,  1954;  Downie,  1952; 
Gage,  1961;  Lovell  and  Haner,  1955) . 

There  is  also  conflicting  evidence  as  to  whether  there 
are  differences  between  the  ratings  given  by  students  taking 
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courses  on  a required  basis  and  those  taking  courses  on  an 
elective  basis.  Cohen  and  Humphreys  (1960)  have  reported 
that  students  taking  a psychology  course  on  a required 
basis  tend  to  give  lower  ratings  than  students  taking  the 
same  course  on  an  elective  basis.  Congruent  with  the  Cohen 
and  Humphreys  (1960)  findings  are  the  results  reported 
by  Gage  (1961)  and  Lovell  and  Haner  (1955) . Both  of  these 
studies  report  that  teachers  of  required  courses  tend  to 
receive  significantly  lower  ratings  than  do  teachers  of 
elective  courses.  On  the  other  hand,  Heilman  and  Armentrout 
(1936)  have  found  no  differences  between  the  ratings  of 
students  taking  required  courses  and  those  taking  elective 
courses. 

Another  demographic  variable  of  interest,  the  students 
major  subject  area,  seems  to  be  uncorrelated  with  student 
ratings.  Cohen  and  Humphreys  (1960),  for  example,  have 
reported  that  psychology  majors  tended  to  rate  instruction 
in  a psychology  course  about  the  same  as  non-psychology 
majors . 

The  predictive  power  of  student  personality  and  in- 
tellectual characteristics  has  been  investigated  by  several 
researchers.  McKeachie  (1969),  Mann  (1969),  and  Elliott 
(1950)  have  found  that  students  who  scored  high  in  the  area 
of  "critical  thinking"  tended  to  rate  their  teachers  high 


on  various  types  of  ratings.  In  particular,  these  students 
tended  to  rate  their  instructors  high  on  stimulation  of 
curiosity,  attention  to  student  reactions,  rapport,  per- 
missiveness, and  flexibility.  In  a recent  study  with 
congruent  findings,  McKeachie,  Lin,  and  Mann  (1971)  re- 
ported that  teachers  whose  students  rated  them  high  in 
"rapport"  tended  to  have  students  who  performed  well  in 
the  area  of  "critical  thinking"  (Costin,  Greenough,  and 
Menges,  1971) . 

Only  one  study  has  reported  the  use  of  student  per- 
sonality characteristics  as  a predictor  of  student  ratings 
of  instruction.  Yonge  and  Sassenrath  (1968)  have  found 

t 

that  self-reported  student  personality  characteristics 
and  student  ratings  of  instruction  are  correlated  within 
classes  but  that  the  observed  correlations  do  not  hold 
from  instructor  to  instructor.  They  have  concluded  that 
ratings  of  instruction  have  different  meanings  from  instruc- 
tor to  instructor  because  of  the  differences  among  in- 
structors in  teaching  methods  and,  ultimately,  because  of 
the  differences  in  the  reactions  of  various  student  per- 
sonalities to  these  differing  methods. 

There  is  conflicting  evidence  as  to  the  value  of 
student  performance  characteristics  as  predictors  of  student 
ratings  of  instruction.  Russell  (1951)  and  Russell  and 
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Bendig  (1953)  have  found  that  overachievers  tend  to  rate 
courses  higher  than  do  underachievers.  However,  the  relation- 
ship was  not  entirely  clear  in  that  the  observed  correla- 
tions were  small  and  the  relationship  was  not  found  to 
extend  to  specific  teacher  skills  taken  separately  (Costin, 
Greenough,  and  Menges,  1971)  . In  contrast,  Reramers  and 
Elliott  (1949)  have  found  no  differences  between  the  ratings 
given  by  overachievers  and  underachievers. 

The  studies  having  the  most  direct  relationship  to  the 
present  study  are  those  attempting  to  correlate  student  ex- 
pectations for  grades  with  student  ratings  of  instruction. 
Numerous  studies  have  found  no  relationship  between  expected 
grades  and/or  received  grades  and  student  ratings  of  in- 
struction (studies  using  received  grades  are  included  here 
in  that  a strong  relationship  has  been  observed  between  ex- 
pected and  received  grades;  Blum,  1936;  and  Walsh,  1967) . 
These  studies  include  Bendig  (1953) , Blum  (1936) , Cohen 
and  Humphreys  (1960),  Eckert  (1950),  Garverick  and  Carter 
(1962),  Guthrie  (1949,  1954),  Heilman  and  Armentrout 
(1936) , Hudelson  (1951) , Remmers  (1928,  1930,  1939,  1960) , 
Russell  (1951) , and  Voeks  and  French  (1960) . 

In  contrast  to  the  findings  of  these  studies,  a 
sizable  number  of  studies  have  reported  significant 
positive  correlations  between  student  grades  and  student 
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ratings  of  instruction.  These  studies  include  Anikeef 
(1953),  caffrey  (1969),  Echandia  (1964),  Elliott  (1950), 
Rayder  (1968),  Rebenstein  and  Mitchell  (1970),  Russell  and 
Bendig  (1953) , Treffinger  and  Feldhusen  (1970) , Walker 
(1969) , and  Weaver  (1960) . It  should  be  noted,  however, 
that  in  these  latter  studies  the  correlations  reported  were 
typically  small.  For  example,  the  large  study  by  Spencer 
(1968)  reported  correlations  of  approximately  .30  between 
grades  and  ratings  of  the  "overall  value  of  course." 

Discussion  of  the  Literature 

Taken  as  a whole,  the  outstanding  characteristic  of 
the  studies  under  discussion  is  their  lack  of  agreement  as 
to  the  relationships  between  student  characteristics  and 
student  ratings  of  instruction.  The  inconclusiveness  of 
the  reported  research  is  particularly  apparent  in  the  areas 
where  there  have  been  a fairly  large  number  of  studies 
reported. 

There  are  many  possible  causes  for  these  conflicting 
results;  such  as,  dissimilar  samples,  dissimilar  instruments, 
dissimilar  experimental  procedures,  etc.,  and  there  can  be 
little  doubt  that  these  causes  have  played  an  important  role 
in  production  of  these  conflicting  results.  It  was,  however, 
the  position  of  this  investigation  that  most  of  these  studies 
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would  have  produced  conflicting  results  even  without  these 
problems  because  they  have,  in  the  main,  overlooked  the 
question  of  how  various  student  characteristics  might  inter- 
act with  varying  modes  of  teacher  behavior.  In  other  words, 
consistent  relationships  were  not  found  because  researchers 
did  not  control  for  the  possibility  that  a given  student 
characteristic  might  account  for  a large  portion  of  the 
variance  in  one  instructor's  ratings  but  not  in  another's. 

Actually,  researchers  have  not  been  completely  unaware 
of  this  possibility.  In  fact,  this  type  of  interaction  has 
been  explicitly  suggested  by  Yonge  and  Sassenrath  (1968) 
who  found  various  student  personality  characteristics  v/ere 
correlated  with  student  ratings  in  some  classes  but  not  in 
others.  As  mentioned  above,  McKeachie,  Lin  and  Mann  (1971) 
have  also  suggested  much  the  same  thing. 

There  is  at  least  one  other  explanation  of  the  con- 
flicting results  which  have  been  reported.  It  may  be  that 
many  of  the  variables  which  have  been  and  which  are  being 
studied  have  not  correlated  with  student  ratings  of  in- 
struction simply  because  they  are  theoretically  and  em- 
pirically irrelevant.  But  it  was  the  position  of  this 
study  that  the  predictive  relevance  of  these  variables  will 
remain  indeterminate  until  studies  using  some  form  of  ex- 
perimental or  statistical  control  for  the  variable  of 


teacher  behavior  are  implemented. 

In  summary,  this  investigation  identified  a weakness 
in  previous  studies  which  had  apparently  contributed  to 
the  inconsistent  findings  which  have  been  reported.  It 
was  the  aim  of  the  present  study  to  avoid  this  weakness 
by  controlling  for  the  interaction  between  the  observed 
student  characteristics  and  the  various  modes  of  teacher 
behavior.  Stogdill's  theory  of  small  group  behavior  was 
used  as  the  conceptual  basis  for  a correlational  design 
which  would  hopefully  effect  the  necessary  control. 


CHAPTER  III 


DESIGN  OF  THE  STUDY 

Definitions 

The  aim  of  this  study  was  to  ascertain  the  nature  of 
student  ratings  of  college  teaching  by  translating  the 
question  of  their  meaning  into  the  terms  of  Stogdill's 
small  group  theory.  As  a first  step  of  translation,  two 
student  expectational  characteristics  were  defined,  and 
their  relationships  with  their  teacher  behavior  counter- 
parts and  with  student  ratings  of  instructxon  were  de- 
lineated in  terras  of  Stogdill's  theory.  Also,  student  rat- 
ings of  college  teaching  were  defined  in  terras  of  two  in- 
struments v^hich  are  in  current  use  at  the  University  of 
Florida. 

Student  expectations  for  teacher  leadership  behavior 
were  defined  in  terms  of  an  appropriate  modification  of 
the  Leader  Behavior  Description  Questionnaire  (LBDQ) . See 
Appendix  A;  Hemphill  and  Coons,  1957.  This  modification, 
called  the  Student  Expectations  Questionnaire  (SEQ;  see 
Appendix  B) , is  regarded  as  being  comprised  of  two  factors: 
expected  "initiating  structure"  (El)  and  expected 
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"consideration"  (EC) . As  will  be  amplified  in  the  discussion 
below,  both  "initiating  structure"  and  "consideration" 
have  been  consistently  found  in  factor  analyses  of  LBDQ  re- 
sponses drawn  from  widely  varying  groups.  Thus,  the  present 
study  contended  that  since  both  of  these  factors  are  known 
to  be  significant  components  of  leadership  behavior  in  other 
groups,  they  are  also  likely  to  be  significant  components  of 
expected  and  observed  teacher  leadership  behavior  as  seen  in 
classroom  groups. 

Student  perceptions  of  teacher  leadership  behavior  were 
similarly  defined  in  terms  of  the  LBDQ.  This  instrument  is 
called  the  Teacher  Behavior  Questionnaire  (TBQ) . See  Appendix 
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B.  The  TBQ  is  considered  to  be  comprised  of  the  same  two 
LBDQ  factors  described  above.  They  are  called  observed 
teacher  "initiating  structure"  behavior  (01)  and  observed 
teacher  "consideration"  behavior  (OC) . 

Fulfillment  of  expectations  for  "initiating  structure" 
and  "consideration"  (the  derived  variables  which  were  used 
as  the  predictors  of  student  ratings)  were  defined  in  the 
following  ways.  Fulfillment  of  expectations  for  "initiating 
structure"  was  defined  as  the  absolute  value  of  the  regressed 
difference  between  each  student's  expected  initiating  struc- 
ture score  and  observed  initiating  structure  score — called 
Regressed  Initiating  Structure  (RI) . Fulfillment  of  expectations 
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for  "consideration"  was  defined  as  the  absolute  value  of  the 
regressed  difference  between  each  student's  expected  con- 
sideration score  and  observed  consideration  score  called 
Regressed  Consideration  (RC) . 

As  stated  above,  this  study  treated  student  ratings 
of  college  teaching  as  an  index  of  student  satisfaction 
with  teacher  leadership  behavior.  Specifically,  student 
satisfaction  with  teacher  leadership  behavior  was  defined 
in  terms  of  two  currently  used  student  rating  instrumeni-s  ^ 
The  more  psychometrically  elaborate  of  the  two,  the  Student 
Student  Evaluation  of  Teacher  Behaviors  Instrument  (TBI; 
Bridges,  Greenwood,  and  Ware,  1971),  is  comprised  of 
eight  factors:  "openness"  (TO),  "teaching  style"  (TS) , 

"evaluation"  (TV) , "effectiveness  of  presentation"  (TP, 
"knowledge  of  content"  (TK) , "communication  skills"  (TC) , 
"commitment  to  teaching"  (TT) , and  "teaching  enthusiasm" 

(TE) , and  a single-item  general  rating  of  the  instructor 
(TG) . The  other  instrument,  the  Student  Report  on  Class- 
room Teaching  Instrument  (CEI,  no  date),  is  considered  to 
be  composed  of  two  sub-scores.  One  is  a total  rating,  the 
mean  of  eleven  diverse  items  (CT) ; the  other  is  a single- 
item global  rating  of  teaching  ability  (CG) . 
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Hypotheses 

Through  the  use  of  selected  multivariate  statistics, 
this  study  attempted  to  predict  a significant  portion  of 
the  variance  in  the  above  defined  set  of  student  ratings  of 
college  teaching.  The  variables,  fulfillment  of  student 
expectations  for  "initiating  structure"  and  "consideration," 
as  defined  above,  were  used  as  predictor  variables.  The 
following  hypotheses  were  tested: 

1.  Within  each  class,  the  canonical  correla- 
tions between  the  set  of  predictor  variables 
(RI  and  RC)  and  the  set  of  student  ratings 
of  instruction  (the  nine  scores  of  the  TBI 
and  the  two  scores  of  the  CEI)  will  be 
equal  to  zero; 

2.  Across  the  several  classes  observed,  the 
canonical  correlations  between  the  set  of 
predictor  variables  for  all  students  (RI 
and  RC)  and  the  set  of  student  ratings  of 
instruction  for  all  students  (the  nine 
scores  of  the  ETB  and  the  two  scores  of 
the  CEI)  will  be  equal  to  zero. 


Sample 

The  population  from  which  the  observed  sample  was 
drawn  is  comprised  of  those  students  attending  classes  in 
the  University  of  Florida  College  of  Education  during  the 
spring,  1972  quarter.  Twenty-three  classes  with  twenty-one 
different  instructors  were  observed.  Because  of  the  sensi- 
tive nature  of  student  ratings  of  college  teaching,  the 
sample  classes  included  only  those  classes  whose  instructors 
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agreed  to  participate  in  this  study.  For  this  reason  the 
representativeness  of  the  sample  cannot  be  assured.  How- 
ever, there  is  little  reason  to  believe  that  the  sample 
was  biased  in  that  the  instructors  who  were  asked  to 
participate  were  selected  on  a random  basis  and  all  v/ho 
were  asked  did  participate.  On  the  other  hand,  two  classes 
which  participated  in  the  early  part  of  the  study  were 
dropped  from  the  sample,  one  because  the  instructor 
felt  that  she  could  not  afford  to  lose  the  class  time 
that  was  needed  for  the  second  day's  data  collection  and 
the  other  because  only  one  participating  student  attended 
class  on  the  second  day  of  data  collection.  In  the  latter 
case,  however,  the  instructor  was  one  of  the  two  instructors 
with  two  classes  participating  in  the  study.  Thus,  this 
instructor  was  not  selectively  excluded  from  the  sample. 

Instruments 

Student  Expectation  and  Teacher  Behavior  Instruments — 
Both  the  Student  Expectation  Questionnaire  (SEQ)  and  the 
Teacher  Behavior  Questionnaire  (TBQ)  are  modifications  of 
Hemphill  and  Coons'  (1957)  Leader  Behavior  Description 
Questionnaire  (LBDQ) . The  LBDQ  was  originally  developed 
by  Hemphill  and  Coons  as  a part  of  the  Ohio  State  Leader- 
ship Studies.  An  early  modification  of  the  instrument,  the 
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one  from  which  the  present  instruments  were  drawn,  was 
designed  to  measure  the  leader  behavior  of  military  task 
group  leaders  (Halpin  and  Winer,  1957) . This  early  in- 
strument and  its  factor  loadings  are  presented  in  Appendix 
A.  Later  forms  were  applied  to  diverse  business,  m.ilitary, 
industrial,  and  school  groups.  Most  of  the  school  appli- 
cations, the  ones  which  would  seem  to  be  of  particular 
relevance  to  the  present  study,  have  dealt  primarily  with 
the  leadership  behavior  of  school  principals  as  observed 
by  teachers.  There  was,  however,  one  application  of  the 
LBDQ  to  the  problem  of  measuring  teacher  classroom  behavior. 
Gibb  (1955)  developed  an  instrument  called  the  Teacher 
Behavior  Description  Questionnaire  v/hich  was  derived 
directly  from  Hemphill's  early  studies  of  airplane  crev; 
commanders  (Hemphill,  Halpin,  and  Winer,  1952).  Unfor- 
tunately, Gibb's  165-item  instrument  was  never  published 
in  its  entirety. 

A significant  characteristic  of  the  LBDQ  is  the  re- 
markable consistency  with  which  two  factors,  "initiating 
structure"  and  "consideration,"  have  been  observed  in 
factor  analytic  studies  of  the  instrument  (Brown,  1967) . 
They  have  been  observed  across  studies  of  both  various 
types  of  groups  and  various  types  of  leaders.  It  was  on 
the  basis  of  this  indirect  evidence  that  the  items  of  the 
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present  SEQ  and  TBQ  were  assumed  to  measure  significant 
aspects  of  the  teacher's  leader  behavior.  It  was  also  on 
the  basis  of  this  evidence  that  the  items  comprising  the  El, 
EC,  01,  and  OC  "factors"  were  selected  and  were  assumed  to  be 
the  classroom  counterparts  of  "initiating  structure"  and 
"consideration"  within  the  present  instruments  (see  Appendix 
B) . In  short,  it  was  maintained  that  the  SEQ  and  the  TBQ 
were  appropriate  for  the  purposes  of  this  study  in  the 
sense  that  they  could  reasonably  be  assumed  to  measure  stu- 
dent attitudes  and  teacher  behaviors  which  are  theoretically 
significant  components  of  the  classroom  social  system. 

It  is,  of  course,  true  that  these  assumptions  could 
have  been  tested  through  factor  analyses  of  the  SEQ  and 
TBQ.  However,  this  procedure  v/as  not  used  for  two  reasons. 
First,  the  internal  consistency  of  the  presumed  El,  EC, 

01,  and  OC  factors  could  be  adequately  estimated  for  the 
exploratory  purposes  of  the  present  study  through  an  item 
analysis  of  each  factor.  Second,  the  development  of  instru- 
ments on  the  basis  of  factor  analysis  is  not  recommended 
by  some  authorities  in  the  area  of  test  construction 
(Nunnally,  1967) . Rather,  the  development  of  items  con- 
sistent with  a systematic  rationale  seems  to  be  preferred. 

The  first  sets  of  SEQ  and  TBQ  items  were  drawn  by  the 
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present  author  from  Halpin  and  Winer's  factors  (see  Appendix 
A) , and  were  tested  in  several  University  of  Florida  classes 
during  the  winter,  197^  quarter.  Students  were  asked  to 
complete  both  instruments  and  to  write  on  their  answer  sheets 
any  comments  they  had  regarding  the  quality  of  the  items, 
the  quality  of  the  instructions,  or  the  quality  of  any  other 
aspect  of  the  instruments.  This  information  was  used  to  make 
the  additional  modifications  in  the  items,  the  format,  and 
the  instructions  which  have  resulted  in  the  present  instru- 

‘fi 

ments  (see  Appendix  B) . 

The  present  data  have  indicated  that  the  four  factors 
of  the  SEQ  and  TBQ  are  both  reliable  and  internally  consis- 
tent. Veldman's  (1967)  TESTAT  program  was  used 'to  compute 
Cronbach ' s coefficient  alpha  (Nunnally,  1967)  and  item-total 
correlations  for  the  items  of  each  factor.  These  data  are 
presented  in  Table  I and  they  seem  to  provide  support  for  the 
argument  that  the  four  factors  as  modified  from  the  Leader 
Behavior  Description  Questionnaire  are  internally  consistent 
and  are  meaningful  to  students  in  the  classroom  setting. 


*A  two-item  addition  placed  at  the  bottom  of  the  SEQ 
asks  students  if  they  have  had  previous  classes  with  the 
instructor  or  if  they  have  knowledge  of  how  he  teaches  his 
classes.  These  items  are  treated  as  demographic  control 
data.  Classification  of  the  present  data  on  the  basis  of 
these  items  is  included  in  Appendix  J. 


TABLE  I 


ITEM-TOTAL  CORRELATIONS  AND  RELIABILITIES 
OF  THE  SEQ  AITO  TBQ  "FACTORS" 


SEQ 

"Factor  " 

TBQ 

"Factor " 

Item 

Number 

EC 

El 

OC 

01 

1 

.46 

.57 

2 

.27 

.21 

3 

.69 

.76 

4 

.22 

.39 

5 

.60 

.65 

6 

.41 

.15 

7 

.52 

.76 

8 

.38 

.48 

9 

.63 

.71 

10 

.16 

.30 

11 

.70 

.79 

12 

.43 

.48 

13 

.50 

.64 

14 

.38 

.43 

15 

.47 

.44 

16 

.51 

.63 

17 

.65 

.67 

18 

.60 

.60 

19 

.55 

.75 

20 

.50 

.42 

21 

.61 

.77 

22 

.44 

.50 

23 

.73 

.81 

24 

.54 

.56 

25 

.72 

.83 

26 

.42 

.51 

27 

. 66 

.75 

28 

.49 

.63 

29 

.66 

.66 

30 

.55 

.62 

N 

347 

347 

347 

347 

X 

36.76 

44.40 

34.78 

53.14 

S.D. 

10.14 

7.49 

14.78 

11.75 

Coef f i- 

cient 

Alpha 

.87 

.65 

.92 

.74 

student  Evaluation  of  College  Teaching  Instruments. — 

The  Student  Evaluation  of  Teacher  Behavior  instrument  (TBI ; 
see  Appendix  c) , which  was  developed  by  Bridges,  Greenwood, 
and  VJare  (1971)  at  the  University  of  Florida,  has  been  factor 
analyzed  into  eight  factors:  "openness”  (TO),  "teaching 

style"  (TS)  , "evaluation"  (TV),  "effectiveness  of  presenta- 
tion" (TP),  "knowledge  of  content"  (TK) , "communication 
skills"  (TC) , "commitment  to  teaching"  (TT) , and  "teaching 
enthusiasm"  (te) . Multiple  regression  techniques  have  been 
used  to  combine  these  factors  into  an  equation  which 
successfully  predicts  a single  item  over-all  student  rating 
of  the  instructor's  performance  (TG) . Table  II  presents 
each  factor's  reliability  and  item-subscale  correlations 
as  estimated  from  the  present  data.  A complete  breakdown 
of  the  factors  showing  their  regression  weights  is  presented 
in  Appendix  c. 

The  Student  Report  on  Classroom  Teaching  instrument 
(CEI , no  date)  was  developed  by  a faculty  committee  at  the 
University  of  Florida.  Most  of  the  items  were  drawn  from  a 
teacher  evalxiation  instrument  which  was  developed  at  Purdue 
University. ' The  CEI  produces  two  scores,  one  is  based  on 
a single-item  general  rating  of  instruction  (CT)  and  the 
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TABLE  II 

ITEM-TOTAL  CORRELATIONS  AND 
RELIABILITIES  OF  THE  TBI  SUBSCORES 


Item 

Num- 

ber 

Factors 

TO 

TS 

TV 

TP  TK 

1 

.47 

2 

.44 

3 

.60 

4 

5 

6 

.42 

7 

8 

9 

.19 

10 

.02 

11 

.72 

12 

.39 

13 

.41 

14 

.50 

15 

.60 

16 

.43 

17 

.40 

18 

19 

.73 

20 

.39 

21 

.51 

22 

.45 

23 

.47 

24 

.36 

25 

.40 

26 

.34 

27 

.55 

28 

29 

.55 

30 

31 

.48 

32 

33 

.34 

34 

.59 

35 

.47 

36 

.18 

37 

.41 

38 

.60 

TC  TT 


.63 

.43 


.64 

.65 


.45 


.59 


TE  TG 


.66 


.68 
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TABLE  II  (Continued) 


Item 

Num- 

ber 


TO 

TS 

TV 

39 

.50 

40 

41 

.57 

42 

.40 

43 

.43 

44 

45 

46 

.63 

47 

.45 

48 

49 

.42 

50 

51 

.42 

52 

.39 

53 

.65 

54 

.01 

55 

.68 

56 

57 

58 

.38 

59 

60 

.50 

61 

TP 


.60 


.30 


TK 


TC 


.55 


TT 


.58 

.55 


.12 


TE  TG 


.71 


. 66 


1.00 


N 

X 


Coef- 
fi- 
cient 


347 

347 

347 

347 

347 

347 

347 

347 

347 

94.17 

85.42 

87.49 

89.80 

86.92 

90.08 

81.46 

92.38 

3.30 

12.78 

22.79 

19.12 

19.37 

23.94 

20.00 

30.59 

18.71 

2.41 

1 0.60 

0.57 

0.64 

0.44 

0.49 

0.34 

0.23 

0.60 

0.00 
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other  is  the  average  of  the  remaining  eleven  items  in  the 
instrument  (CG) . The  reliability  of  the  eleven-item  sub- 
score and  its  item-total  correlations  are  presented  in 
Table  III.  The  CEI  is  presented  in  Appendix  D. 

The  CEI  also  requests  demographic  information  regard- 
ing the  student's  college  standing,  undergraduate  G.P.A., 
estimated  grade  in  present  course,  college  of  enrollment, 
sex,  and  reason  for  taking  the  course  (see  Appendix  D). 

Scoring  of  the  Instruments 

The  data  were  punched  on  standard  data  cards  and  the 
instruments  were  scored  by  FORTRAN  computer  programs.  The 
lists  of  these  programs  in  Appendix  E offer  a detailed 
presentation  of  the  scoring  procedures.  The  following  is 
a summary  of  those  procedures. 

The  SEQ  and  TBQ  are  each  composed  of  two  fifteen-item 
factors  (EC,  El,  and  OC,  01  respectively) . On  the  SEQ, 
students  were  asked  to  indicate  their  expectations  for  the 
frequency  with  which  they  expected  to  see  each  of  the 
teacher  behavior  items  by  circling  a number  from  one  to 
seven — one  indicating  "always"  and  seven  indicating  "never." 
On  the  TBQ,  students  were  asked  to  use  the  same  scale  to 
indicate  the  frequency  with  which  the  teacher  actually 
engaged  in  these  same  teacher  behaviors  (see  Appendix  B for 
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TABLE  III 

ITEM-TOTAL  CORRELATIONS  AND  RELIABILITIES 
OF  THE  CEI  SUBSCORES 


Item  Number 

CG 

CT 

1 

1.00 

2 

.61 

3 

.72 

4 

.59 

5 

.65 

6 

.59 

7 

.68 

8 

1 

.65 

9 

.67 

10 

.57 

11 

.62 

12 

.55 

N 

347 

347 

X 

2.41 

24.42 

S.D. 

1.15 

8.55 

Coefficient 

Alpha 

0.00 

.83 
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complete  instructions) . The  SEQ  and  the  TBQ  scores  were 
computed  with  program  PSEQTBQ  (see  Appendix  E) : 

1.  Across  subject  means  (within  each  class) 
were  substituted  for  all  missing  data  values; 

2.  The  raw  data,  with  missing  values  sub- 
stituted, were  punched  for  use  in  Veldman's 
(1967)  TESTAT — a reliability  and  item- 
analysis  program; 

3.  Items  9,  13,  15,  and  17  of  the  EC  and  OC 
scales  were  scored  in  reverse  in  accordance 
with  their  factor  loadings  from  Halpin  and 
Weiner's  (1957)  original  study.  The  same 
procedure  was  used  for  item  14  of  the  El 
and  01  scales; 

4.  The  items  comprising  each  "factor"  were 
summed  into  scale  totals  and  punched  for 
further  analysis. 

The  TBI  is  composed  of  eight  multi-item  factors  total- 
ing sixty  items  and  a single- item  general  rating.  The 
student  was  instructed  to  read  each  item  and  to  respond 
by  (1)  leaving  it  blank,  meaning  that  the  behavior  described 
was  irrelevant,  by  (2)  circling  a one,  meaning  that  the  item 
was  relevant  and  was  descriptive  of  the  instructor  being 
evaluated,  or  by  (3)  circling  a two,  meaning  that  the  be- 
havior was  relevant  to  the  class  but  did  not  describe  the 
instructor  in  question  (see  Appendix  C for  the  complete 
instructions) . The  TBI  was  scored  with  program  PTBI  (see 
Appendix  E) ; 

1.  The  score  of  each  factor  for  each  student 
was  computed  by  dividing  the  total  weights 
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of  all  positively  weighted  items  marked 
with  a one  (a  one  indicating  that  the  item 
described  the  instructor's  behavior)  by  the 
total  weights  of  all  positively  weighted 
items  marked  with  a one,  plus  the  absolute 
value  of  the  total  of  all  negatively 
weighted  items  marked  with  a two  (a  two 
indicating  that  the  item  did  not  describe 
the  instructor’s  behavior).  This  ratio 
was  multiplied  by  100  producing  scores 
ranging  from  0 to  100  for  each  factor. 

2.  Class  averages  were  substituted  for  missing 
values  of  the  single-item  general  rating. 

3.  The  eight-factor  scores  and  the  single -item 
general  rating  were  punched  for  further 
analysis . 

The  CEI  is  composed  of  eleven  specific  items  and  one 
general  evaluation  item  to  which  students  were  asked  to 
respond.  There  v/ere  five  response  options  on  the  one-item 
general  rating  and  either  six  or  seven  options  on  each  of 
the  eleven  specific  ratings  (one  option  for  each  of  the 
eleven  specific  ratings  was  a not-applicable  response) . 

The  options,  which  varied  in  wording  from  item  to  item,  are 
presented  in  Appendix  D.  The  CEI  was  scored  with  Program 
PCEI  (see  Appendix  E) : 

1.  Across  subject  averages  (excluding  not  appli- 
cable responses)  were  substituted  for  missing 
values  on  all  twelve  items; 

2.  The  raw  data  with  missing  values  substituted 
were  punched  for  further  analysis; 
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3.  A weighted  mean  of  items  two  through  twelve, 
excluding  the  not-applicable  responses,  was 
computed  for  each  student.  The  items  having 
six  options  (excluding  the  not-applicable 
option)  were  given  an  appropriate  fractional 
weight  in  order  to  avoid  the  disproportional 
influence  they  would  otherv/ise  have  had  in 
the  average; 

4.  Item  one  (the  singles- item  general  rating)  and 
the  weighted  mean  of  items  two  through  twelve 
were  punched  for  further  analysis. 


Data  Collection  procedures 


The  data  were  collected  during  two  regular  class  periods 

The  first  of  these  was  the  first  day  of  class  before  any  of 

. * ... 

the  class  members  had  seen  their  instructor.  At  this  time 
students  were  asked  to  respond  to  the  Student  Expectation 

t 

Questionnaire.  Also,  they  were  told  that  additional  data 
would  be  collected  around  the  end  of  the  quarter.  Nothing 
was  said  regarding  the  relationship  of  the  SEQ  to  the  stu- 
dent evaluation  of  teaching  instruments.  The  total  class 
time  used  was  less  than  ten  minutes  per  class. 

In  order  that  the  SEQ,  TBQ,  and  evaluation  of  teaching 
instruments  might  be  matched  in  the  correlational  analysis, 
each  student  was  asked  to  put  some  identifying  mark  in  the 


This  condition  was  not  adhered  to  in  the  case  of  one 
class.  However,  subsequent  inspection  of  the  data  did  not  in 
dicate  that  the  variance  of  expectations  in  this  class  was 
significantly  different  from  other  classes.  Also,  two  ques- 
tions were  placed  at  the  end  of  the  SEQ  in  an  attempt  to  con- 
trol the  effect  of  prior  acquaintance  with  the  instructor 
on  student  expectations  (see  Appendix  B) . 
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upper  right-hand  corner  of  the  SEQ  instrument  which  he  com- 
pleted (see  Appendix  F for  the  student's  instructions). 

This  identifying  mark  was  one  which  each  student  alone 
could  recognize  as  his  or  her  own.  When  the  proctor  re- 
turned, around  the  end  of  the  quarter,  each  of  the  (SEQ) 
instruments  from  the  first  session  were  displayed  in- 
dividually before  the  class  and  each  student  was  asked  to 
identify  his  personal  mark  (this  process  was  intended  to 
remind  each  student  of  his  mark) . With  the  use  of  this 
procedure,  almost  all  of  the  students  had  no  trouble  v;ith 
recalling  and  using  the  same  identifying  mark  on  the  instru- 
ments given  the  second  day.  Thus,  the  instruments  com- 
pleted by  each  student  were  identified  and  matched  without 
a violation  of  student  anonymity. 

The  second  day  of  data  collection  was  a date  close  to 
the  end  of  the  quarter  which  was  convenient  for  the  instruc- 
tor. On  this  day  the  TBQ,  TBI , and  CEI  were  administered 
in  the  following  order  (see  Appendix  G for  the  proctor's 
instructions) . First,  all  students  in  each  class  were 
shown  the  SEQ  forms  from  the  first  day  of  class.  Second, 
each  student  who  recognized  his  identifying  mark  was  asked 
to  respond  to  the  TBQ  and  to  again  use  his  identifying 
mark.  Third,  while  the  above- designated  group  filled  out 
the  TBQ,  all  other  students  were  given  the  TBI  and  the  CEI 


along  with  a note  instructing  theia  to  answer  all  questions 
and  to  leave  the  room  v/hen  finished  (see  Appendix  H,  Note 
number  1) , Fourth,  the  first  group  of  students  were  asked 
to  come  forward  to  receive  additional  instructions  once 
they  had  completed  the  TBQ.  At  this  time  they  were  given 
the  TBI  and  the  CEI  along  with  a note  instructing  them  to 
complete  all  questions  and  to  mark  each  answer  sheet  with 
their  identifying  mark  (see  Appendix  H,  Note  number  2) . 

Note  that  these  written  instructions  were  the  first  indica- 
tion given  the  students  regarding  the  association  between 
the  SEQ,  TBQ,  and  the  evaluation  of  teaching  instruments. 
Thus,  there  was  an  attempt  to  prevent  student  response  from 
being  affected  by  anticipation  of  the  data  collection  pro- 
cedures. The  total  class  time  used  for  this  procedure  was 
close  to  45  minutes  per  class. 

The  process  of  data  collection,  as  outlined  above,  was 
first  tested  in  a pilot  study.  As  was  noted  above,  the 
primary  aim  of  this  pilot  study  was  to  obtain  student  re- 
action to  the  instruments  and  to  identify  any  outstanding 
difficulties  in  the  data  collection  process. 

Statistical  Design 

The  statistical  analysis  of  the  data  was  accomplished 
primarily  through  the  use  of  the  University  of  Florida  IBM 


360/60  computer.  The  programs  used  were  selected  from 
those  described  in  Dixon's  (1971)  BMP  Biomedical  computer 
programs  and  Veldman's  (1967)  FORTRAN  programming  for  the 
behavioral  sciences.  All  raw  data  were  keypunched  and 
summarized  as  a first  step  of  this  analysis.  The  following 
presentation  is  an  outline  of  the  statistical  procedures 
used. 

Analysis  of  Instruments. — The  means  and  standard  de- 
viations of  all  measures  by  class  groups  were  produced. 
Also,  the  means  and  variance  of  all  measures  were  produced 
on  the  basis  of  the  following  classifications:  current 

college  class,  overall  undergraduate  grade  point  average, 
estimated  grade  in  course,  major  area  of  study,'  sex,  rea- 
son for  taking  course,  and  knov/ledge  of  the  instructor's 
teaching  methods  (see  Appendix  J) . 

Veldman's  TESTAT  was  used  to  calculate  Cronbach's 
coefficient  alpha  (Nunnally,  1967)  as  an  index  of  the 
reliability  of  each  factor  and  each  subscore  within  each 
test.  Coefficient  alpha  is  an  estimate  of  the  correlation 
between  the  sample  of  items  used  in  each  measure  and  a 
hypothetical  alternate  form. 

Veldman's  TESTAT  was  also  used  to  produce  an  item  by 
item  analysis  of  internal  consistency  for  all  factors  and 
subscores  of  all  the  instruments  used.  This  analysis  was 
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expressed  in  terms  of  item-total  correlations. 

Biomedical  program  BMD  OSD  (Dixon,  1971)  was  used  to 
produce  histograms  for  all  sets  of  data.  This  same  program 
was  also  used  to  produce  scatterplots  of  the  correlated 
variables.  These  data  were  intended  to  provide  a simple 
way  of  inspecting  the  various  data  distributions  for 
normality. 

Generation  of  Derived  Scores. — Fulfillment  of  student 
expectations,  the  measure  of  interaction  between  student 
expectational  characteristics  and  observed  teacher  be- 
havior, was  computed  by  taking  the  absolute  value  of  the 
regressed  difference  between  El  and  01,  and  EC  and  OC,  lor 
each  student.  Brown's  (1970)  Regressed  Gain  program  (see 
Appendix  I)  was  used  for  this  procedure.  This  particular 
derived  score  was  used  in  order  to  avoid  the  statistical 
regression  bias  ordinarily  present  in  difference  scores 
(Tracy  and  Rankin,  1967) . The  effect  of  a regression 
artifact  Vi/ould  have  been  to  make  subjects  with  extreme  SEQ 
scores  more  likely  to  have  large  difference  scores. 

Tests  of  Hypotheses .—Since  all  of  the  hypothesized 
relationships  contained  more  than  one  predictor  variable 
and  more  than  one  criterion  variable,  canonical  correlation 
was  used  to  estimate  the  relationships  between  each  set. 
Specifically,  the  calculations  were  made  on  the  University 
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of  Florida  IBM  360/60  computer  using  Veldraan's  CANONA 
program  (Veldman,  1967) . The  following  canonical  relation- 
ships were  computed  and  their  corresponding  null  hypotheses 
were  tested  with  the  chi-square  statistic  recommended  by 
Cooley  and  Lohnes  (1971) . 

1.  Within  each  class  the  canonical  correlation 
between  the  set  of  predictor  variables,  com- 
posed of  RI  and  RC,  and  the  set  of  student 
ratings,  composed  of  TO,  TS,  TV,  TP,  TK,  TC, 

TT,  TE,  TG,  CT,  and  CG,  is  greater  than 
zero . 

2.  Across  the  several  classes  observed,  the 
canonical  correlation  between  the  set  of 
predictor  variables,  comprised  of  RI  and  RC, 
and  the  set  of  student  ratings,  comprised 
of  TO,  TS,  TV,  TP,  TK,  TC,  TT , TE,  TG,  CT , 
and  CG,  is  greater  than  zero. 


CHAPTER  IV 


RESULTS,  DISCUSSION,  CONCLUSIONS, 

AND  SUGGESTIONS  FOR  FUTURE  RESEARCH 

Results 

Table  IV  presents  the  number  of  subjects,  the  means, 
and  the  standard  deviations  for  all  variables  within  each- 
class . The  classes  are  identified  as  graduate  or  under- 
graduate according  to  their  course  number. 

The  first  null  hypothesis  of  the  present  study  was 
that  there  would  be  no  canonical  correlations  significantly 
greater  than  zero  between  the  set  of  predictor  variables, 
fulfillment  of  expectations  for  "initiating  structure"  and 
"consideration, " and  the  set  of  student  ratings  of  instruc- 
tion within  any  of  the  classes  observed.  This  hypothesis 
was  not  tested  in  every  class  because  the  number  of  subjects 
in  several  of  the  classes  was  too  small  for  analysis  by  the 
CANONA  program  (Veldman,  1967)  . Thus,  the  first  hypothesis 
was  tested  in  thirteen  of  the  twenty-one  classes  from  which 
complete  sets  of  data  were  collected.  Table  V presents  the 
canonical  roots,  chi-square  values,  and  the  correlations 
between  the  canonical  roots  and  each  variable  for  each  of 
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MEANS  AND  STANDARD  DEVIATIONS  FOR  ALL 
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the  thirteen  largest  classes. 

From  an  inspection  of  Table  V,  it  is  apparent  that 
the  first  null  hypothesis  can  be  rejected  for  the  first 
root  in  eight  of  the  thirteen  largest  classes.  Thus,  the 
first  hypothesis  seems  to  receive  partial  support  from  the 
data  in  the  thirteen  largest  classes.  However,  as  will  be 
explained  below,  the  practical  significance  of  the  relation- 
ship is  questionable. 

The  second  null  hypothesis  of  the  present  study  was 
that  for  all  classes  combined  the  canonical  correlations 
between  the  set  of  predictor  variables  and  the  set  of 
student  ratings  of  instruction  is  not  significantly  greater 
than  zero.  Table  VI  presents  the  canonical  roots,  chi- 
square  values,  and  the  correlations  of  each  variable  with 
each  root  for  all  classes  combined.  The  highly  signifi- 
cant first  root  shown  in  Table  VI  indicates  that  the  data 
support  the  second  hypothesis  of  this  study.  Once  again, 
however,  it  must  be  said  that  the  practical  significance 
of  this  relationship  is  questionable. 

The  questions  as  to  the  meaning  and  significance  of  the 
above  correlations  stems  from  the  fact  that  a crucial  limita- 
tion on  the  interpretation  of  these  data  was  found  to  be  com- 
promised. As  stipulated  in  the  proposal,  the  suitability 
of  the  regressed  difference  score  as  an  index  of  fulfillment 
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TABLE  VI 

CANONICAL  ROOTS  AND  ROOT -VARIABLE 
CORRELATIONS  FOR  ALL  CLASSES  COMBINED 
USING  REGRESSED  DIFFERENCE  SCORES 


Root  I 

Root  II 

Rr^ 

0.45 

0.04 

203.53^ 

12.86 

df 

12.00 

10.00 

RC 

1.00 

-0.08 

RI 

0.26 

0.97 

w 

TO 

-0.76 

0.38 

C 

0 

•H 

-p 

TS 

-0.79 

-0.26 

fd 
1 — I 
(U 
L 

TV 

-0.25 

-0.74 

t 

P 

O 

U 

TP 

-0 . 66 

-0.08 

0) 

rH 

TK 

-0.52 

-0.19 

•H 

P 

TC 

-0.68 

0.10 

> 

1 

-P 

0 

TT 

-0.42 

-0.05 

0 

Pi 

TE 

-0.20 

0.07 

TG 

0.71 

0.33 

CG 

0.57 

0.13 

CT 

0.70 

0.39 

< .01. 


of  student  expectations  for  "initiating  structure"  and 
"consideration"  was  dependent  on  the  assumption  that  the 
greatest  portion  of  the  correlated  variance  in  this  dif- 
ference score  would  be  contributed  by  the  SEQ  scores  and 
that  only  a minimal  part  of  the  variance  would  be  contributed 
by  the  TBQ  scores.  The  findings  indicate,  however,  that 
this  was  not  the  case.  From  Table  VII  it  is  clear  that  the 
TBQ  scores  (OC  and  01)  contain  a substantial  amount  of 
variance  which  is  correlated  with  the  student  rating  of 
instruction  scores.  Thus,  a substantial  portion  of  the 
variance  in  the  regressed  difference  scores  may  be  attri- 
butable to  a type  of  halo  effect  which  caused  students  to 
respond  in  a similar  way  to  both  the  TBQ  and  to  the  student 
ratings  of  instruction,  both  of  which  were  given  on  the  same 
day.  As  a result  of  this  evidence,  it  was  felt  that  data 
supporting  the  original  hypotheses  would  be  of  questionable 
significance  without  modifications  of  the  statistical  treat- 
ments of  the  data.  The  following  supplemental  procedures 
were  used  in  an  effort  to  provide  more  appropriate  tests  of 
the  hypotheses. 

Supplemental  Results 

In  order  to  eliminate  the  variance  contributed  by  the 
TBQ  from  the  regressed  difference  socres,  class  means  were 


intercorrelatiojT  matrix  of  all  original 
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computed  for  the  TBQ  variable  in  each  of  the  twenty-one 
classes.  The  regressed  difference  score  for  each  student 
was  then  recalculated  using  the  appropriate  class  mean  TBQ 
score  in  place  of  the  individual  student's  TBQ  score.  Thus, 
a statistic  which  varies  only  as  a function  of  the  algebraic 
interaction  between  expectations  and  one  non-varying 
measure  of  the  instructor's  mode  of  behavior  was  produced. 
The  intercorrelations  of  these  modified  regressed  difference 
scores  (MRC  and  MRI)  and  the  student  ratings  of  instruction 
are  presented  in  Table  VIII. 

The  modified  difference  scores  were  used  in  a re- 
analysis of  the  data.  As  indicated  in  Table  IX,  however, 
the  modified  difference  scores  were  somewhat  ineffective 
in  providing  support  for  the  hypotheses.  Clearly,  the  null 
hypotheses  cannot  be  rejected  in  the  thirteen  largest 
classes.  In  only  one  case  does  the  first  root  have  a 
significance  beyond  the  .05  level,  and  in  interpreting  this 
instance  one  must  take  into  account  the  probability  of  find- 
ing a root  of  such  magnitude  among  the  substantial  number 
of  correlations  produced. 

Table  X presents  the  canonical  analysis  of  all  classes 
taken  together  using  the  modified  difference  scores.  This 
analysis  provides  some  limited  support  for  the  hypotheses. 
Two  roots  which  are  significant  beyond  the  .01  level  were 
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TABLE  VIII 

INTERCORRELATIONS  OF  THE  MODIFIED 
REGRESSED  DIFFERENCE  SCORES 


MRC 

MRI 

MRC 

1.00 

1 

1 
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to 

MRI 

-0.02 

1.00 

TO 

-0.33 

0.00 

TS 
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0.10 

TU 

o 

o 

« 

0 

1 

0.18 

TP 

-0.22 

0.03 

TK 

-0.28 

0.08 

TC 

-0.21 

-0.12 

TT 

-0.27 

0.15 

TE 

-0.06 

-0.14 

TG 

0.32 

-0.05 

CG 

0.32 

0.04 

CT 

0.29 

-0.13 

ROOTS  AND  ROOT-VARIABLE  CORRELATIONS  FOR  THE  THIRTEEN 
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TABLE  X 

CANONICAL  ROOTS  AND  ROOT -VARIABLE 
CORRELATIONS  FOR  ALL  CLASSES  COMBINED 
USING  MODIFIED  REGRESSED  DIFFERENCE  SCORES 


Root  I 

Root  II 

x2 

df 

0.20 

76.98^ 

12.00 

0.14 

50.00^ 

10.00 

RC 

1.00 

0.08 

RI 

-0.10 

0.99 

TO 

-0.73 

-0.08 

TS 

-0.71 

0.19 

TU 

-0.04 

0.48 

TP 

-0.50 

0.01 

TK 

-0.64 

0.15 

TC 

-0.43 

-0.39 

TT 

-0.61 

0.32 

TE 

-0.11 

-0.38 

TG 

0.71 

-0.05 

CG 

0.71 

0.19 

CT 

0.66 

-0.28 

< .01. 
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extracted  but  their  usefulness  must  be  questioned  because  of 
their  small  size.  The  first  root  of  the  predictor  set  can 
account  for  only  20  per  cent  of  the  variance  in  the  first 
root  of  the  student  rating  set  while  the  second  root  can 
account  for  only  13  per  cent  of  the  variance  in  its  second- 
set  counterpart. 

A statistic  developed  by  Stewart  and  Love  (Cooley  and 
Lohnes,  1971)  called  redundancy  provides  a more  accurate 
perspective  of  the  meaning  and  usefullness  of  these  two 
roots.  The  redundancy  is  a measure  of  the  proportion  of 
the  variance  in  one  set  of  variables  which  is  redundant 
to  the  variance  known  from  another  set  of  variables  (Cooley 
and  Lohnes,  1971) . In  the  case  of  the  present  study,  it 
is  the  amount  of  variance  in  the  student  ratings  of  instruc- 
tion redundant  to  the  variance  in  the  set  of  fulfillment  of 
expectation  scores  which  is  of  concern.  Given  the  two 
significant  canonical  roots  found  in  the  analysis  of  the 
combined  classes,  it  can  be  said  that  the  redundancy  of  the 
student  ratings  of  instruction  was  on  the  order  of  .08  or 
8 per  cent.  In  other  words,  approximately  8 per  cent  of  the 
information  in  the  student  ratings  of  instruction  was  ac- 
counted for  in  terms  of  the  fulfillment  of  expectation 
variables  that  were  used  in  this  investigation. 
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Before  the  discussion  of  the  results,  it  should  be 
noted  that  the  means  and  standard  deviations  of  each 
variable  as  stratified  into  various  traditionally  used 
categories  were  inspected  in  order  to  estimate  the  homo- 
geneity of  the  many  subgroups.  These  statistics  are  pre- 
sented in  Appendix  J.  No  differences  which  would  affect 
the  substantive  findings  of  this  study  were  found. 

Discussion  and  Conclusions 

In  general,  the  data  provided  only  weak  support  for 
the  hypotheses.  The  chi-square  values  of  the  original 
hypotheses  presented  in  Table  V indicate  that  in  only  eight 
of  the  thirteen  largest  classes  were  the  first  roots  (the 
roots  corresponding  primarily  to  fulfillment  of  expecta- 
tions for  "consideration")  significant  at  the  .05  level. 

Table  V further  indicates  that  the  second  roots  (the  roots 
corresponding  primarily  to  "initiating  structure")  were 
significant  (at  the  .05  level)  in  only  one  case.  And,  as  has 
been  previously  mentioned,  this  one  case  must  be  interpreted 
cautiously.  In  Table  VI  the  significant  first  root  (the 
one  corresponding  to  fulfillment  of  expectations  for 
"consideration")  indicates  that  there  was  a substantial  por- 
tion of  shared  variance  (45  per  cent)  between  the  first 
principal  components  of  each  set.  Taken  together,  the  data 
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from  Tables  V and  VI  seem  to  provide  some  support  for  the 
hypothesis  that  there  was  a relationship  between  the  degree 
to  which  students'  expectations  for  the  instructor's 
"consideration"  behavior  were  fulfilled  and  the  favorable- 
ness of  the  ratings  which  they  give  their  instructor. 

The  chi-square  values  presented  in  Table  IX  indicate 
that  there  was  no  relationship  between  the  set  of  modified 
regressed  difference  scores  and  the  student  ratings  of  in- 
struction. This  result  suggests  that  the  variance  in 
the  difference  scores  which  can  be  known  from  the  student 
expectations  scores  alone  is  not  sufficiently  large  to  be  of 
any  use  in  the  practical  matter  of  predicting  student  rat- 
ings of  instruction  within  individual  classes.  In  other 
words,  the  data  indicate  that  the  expectational  diffe'rences 
among  students  as  seen  within  classes  cannot  be  said  to 
account  for  any  significant  portion  of  the  variance  in  the 
ratings  given  a particular  instructor  in  a particular  class. 

As  indicated  in  Table  X,  both  the  first  and  second  roots 
extracted  from  the  group  of  all  classes  combined  were  signifi- 
cant at  the  .01  level.  These  results  seem  to  indicate  that 
a significant  portion  of  the  variance  in  the  student  ratings 
of  instruction  can  be  known  from  the  variance  in  student 
expectation  scores  when  a sufficiently  large  group  of  stu- 
dents is  being  observed.  The  practical  value  of  this 
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relationship  is  in  its  possible  application  to  the  problem 
of  assignment  of  students  to  instructors.  If  the  predictive 
relationship  found  in  these  data  holds  for  other  student 
populations,  it  could  be  used  as  a basis  for  matching  stu- 
dents and  instructors  in  such  a way  that  student  satis- 
faction with  instruction  would  be  increased. 

The  data  of  this  study  are  relevant  to  the  interpreta- 
tion of  student  ratings  of  instruction  in  one  other  way. 

If  it  is  true  that,  as  the  present  findings  indicate,  a 
small  portion  of  the  variance  in  student  ratings  of  instruc- 
tion can  be  known  from  the  distribution  of  student  expecta- 
tional  characteristics,  it  can  be  said  that  an  instructor's 
ratings  are  affected  at  least  in  small  part  by  the  fortune 
or  misfortune  he  has  in  enrolling  students  whose  expecta- 
tional  characteristics  match  his  typical  mode  of  teaching 
behavior.  The  implication  of  this  finding  is  that,  even  with 
very  reliable  student  ratings,  small  differences  between 
instructor  ratings  from  classes  with  students  of  unknown 
characteristics  are  practically  uninterpretable. 

In  summary,  this  study  attempted  to  rectify  a presumed 
weakness  in  the  research  literature  dealing  with  student 
ratings  of  instruction.  Specifically,  it  was  determined 
that  previous  studies  had  not  answered  the  question  of  how 
the  interaction  of  student  characteristics  and  various  modes 
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of  teacher  behavior  are  related  to  student  ratings  of  instruc 
tion.  Stogdill's  small  group  theory  was  used  as  a basis  for 
delineating  the  course  of  this  interaction,  and  modifications 
of  the  Leader  Behavior  Description  Questionnaire  were  used 
to  measure  both  student  characteristics  and  teacher  behaviors. 
The  general  hypothesis  that  discrepancies  between  student 
expectations  and  observed  teacher  behavior  are  predictively 
related  to  student  ratings  of  instruction  was  tested  in  a 
sample  of  graduate  and  undergraduate  students  at  the  Univer- 
sity of  Florida.  The  results  indicate  that  there  was  some 
relationship,  particularly  between  fulfillment  of  expecta- 
tions for  "consideration"  and  student  ratings  of  instruction. 
However,  the  relationship  was  found  to  be  so  smalx  thaL. 
became  statistically  significant  only  in  sizeable  groups. 

It  is  suggested  that  this  relationship  has  some  practical 
implications  in  the  area  of  assignment  of  students  to  in- 
structors and  in  the  area  of  interpretation  of  student 
ratings  of  instruction. 

Suggestions  for  Future  Research 

A portion  of  the  variance  in  student  ratings  of  instruc- 
tion which  is  theoretically  significant  but  apparently  of 
limited  practical  importance  was  found  to  be  related  to 
student  expectational  characteristics.  There  were,  however. 
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several  reasons  why  the  observed  relationships  can  be  con- 
sidered a conservative  indication  of  the  true  relationships 
between  fulfillment  of  expectations  and  student  ratings  of 
instruction.  The  fol] owing  limitations  are  all  ones  which 
would  have  served  to  reduce  the  magnitude  of  the  present 
correlations  and  they  should  be  given  consideration  by  both 
consumers  of  the  present  findings  and  future  investigators 
in  this  area  of  research. 

The  first  of  these  limitations  is  in  the  area  of  design. 
The  sample  used  in  this  study  was  composed  of  classes  whose 
instructors  were  willing  to  participate  in  the  study.  Although 
there  was  no  obvious  bias  in  the  selection  of  classes  for  the 
study  or  in  the  mortality  of  classes  from  the  study,  an  in- 
spection of  the  TBQ  means  indicates  that  the  participating 
instructors  were  generally  well  up  into  the  high  end  of  the 
score  range  of  the  instrument  on  both  factors.  Unques- 
tionably, this  observation  is  not  firm  evidence  that  the 
sample  was  biased  in  that  there  are  no  norms  available  to 
which  the  present  scores  can  be  compared.  In  fact,  this 
problem  could  be  alternatively  viewed  as  a weakness  of  the 
TBQ  instrument  which  may  not  have  been  able  to  adequately 
discriminate  within  the  observed  sample.  Whichever  is  the 
case,  it  is  suggested  that  the  magnitude  of  the  hypothesized 
relationships  may  not  have  been  accixrately  reflected  in  the 
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present  findings.  In  other  words,  there  is  the  possibility 
that  either  the  nature  of  the  sample  or  the  sensitivity  of 
the  instrument  might  have  effected  a shortened  range  of 
responses  and  that  this  impediment  reduced  the  magnitude  of  the 
observed  correlations. 

It  should  be  added  that  this  type  of  limitation  was 
also  operating  in  the  student  sample.  Numerous  students 
who  filled  out  the  SEQ  on  the  first  day  of  class  were  not 
in  attendance  on  the  day  when  the  TBQ  and  student  ratings 
of  instruction  were  collected.  Thus,  the  students  who  were 
so  excluded  from  the  sample  were  likely  to  include  a 
selectively  high  proportion  of  students  who  did  not  like 
the  course  and  who,  in  many  cases,  had  dropped  the  course. 

Another  problem  which  was  likely  to  have  contributed 
to  the  small  correlations  observed  in  this  study  was  the 
association  which  students  were  able  to  make  between  the 
student  ratings  of  instruction  and  the  TBQ  instrument. 

Even  though  students  were  not  given  the  written  instruc- 
tions about  the  TBI  and  CEI  until  after  they  had  completed 
the  TBQ,  students  in  several  classes  made  verbal  comments 
indicating  that  they  considered  the  TBQ  to  be  another 
student  evaluation  of  instruction  form.  Thus,  it  is  quite 
possible  that  the  substantial  correlation  between  the  TBI 
and  the  student  ratings  of  instruction  v/as  attributable  to 
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a general  evaluation  halo  which  influenced  all  three  in- 
struments. Such  an  association  on  the  part  of  the  student 
would  be  particularly  understandable  when  it  is  realized 
that,  in  most  classes,  students  were  told  by  the  instructor 
that  the  class  period  (second  day  of  data  collection)  would 
be  devoted  to  student  ratings  of  instruction  and,  further- 
more, that  the  same  proctor  handed  out  both  the  TBQ  and  the 
student  ratings  of  instruction. 

Some  of  the  most  serious  limitations  of  the  present 
study  were  presented  by  the  variance-reducing  effects  of  the 
statistical  analyses.  The  transformation  of  the  raw  dif- 
ference scores  into  regressed  difference  scores  and  into  the 

I 

modified  regressed  difference  scores  substantially  reduced 
the  variances  of  each  distribution.  Then  the  remaining 
variance  was  effectively  halved  by  taking  the  absolute  value 
of  the  regressed  difference  scores.  Such  drastic  reduc- 
tions in  variance  could  only  have  had  the  effect  of  greatly 
diminishing  the  magnitude  of  any  correlational  relationship 
between  the  predictor  and  student  rating  variables. 

However,  all  of  these  procedures  were  necessary. 

Without  the  use  of  the  regressed  difference  scores  there 
would  have  been  a marked  regression  artifact  interfering 
with  the  magnitude  and  distribution  of  each  set  of  dif- 


ference scores,  without  the  use  of  the  modified  difference 
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scores  (which  held  the  variability  of  the  TBQ  scores  to 
zero)  any  support  for  the  hypotheses  would  have  been  open 
to  the  question  whether  the  correlations  were  of  any 
value.  Without  the  use  of  the  absolute  values  of  the 
difference  scores  the  hypotheses  of  the  study  could  not 
have  been  tested  (Stogdill's  theory  holds  that  the  absolute 
size  of  the  discrepancy  between  expectations  and  observed 
behavior  predicts  satisfaction) . 

Another  area  of  difficulty  was  presented  by  the 
skewed  distributions  of  all  of  the  predictor  scores  and 
most  of  the  criterion  scores.  Both  sets  of  regressed 
difference  scores  (the  RC,  RI , and  MRC,  MRI)  were  skewed 
as  a result  of  having  been  modified  by  the  absolute  value 
function.  Their  appearance  resembled  that  of  a norma-1  dis- 
tribution which  had  been  folded  at  the  mean  with  the  nega- 
tive scores  overlapped  onto  the  positive  half  of  the  scale. 
This  type  of  distribution  is  exactly  what  would  be  expected 
from  the  procedures  used.  The  distributions  of  the  eight 
TBI  factors  were  also  skewed  but  not  because  of  any  statis- 
tical manipulations  performed  by  the  investigator.  Ap- 
parently these  skewed  distributions  ordinarily  result  from 
the  TBI  as  a product  of  its  recommended  scoring  procedure.* 


*C.  Bridges,  personal  communication. 


64 


One  way  in  which  the  effects  of  these  skewed  distri- 
butions could  have  been  reduced  would  have  been  through  the 
use  of  some  type  of  score  transformation  for  each  variable. 
However,  this  possibility  was  explored  and  found  not  to  be 
feasible.  According  to  Kirk  (1968) , appropriate  trans- 
formations can  be  found  only  for  those  sets  of  scores  in 
which  the  means  and  variances  are  proportional.  However, 
such  was  not  the  case  with  the  difference  scores  used  in 
the  present  study.  Thus,  the  observed  correlations  were 
diminished  by  the  skewness  of  both  the  predictor  scores  and 
the  student  rating  of  instruction  scores. 

One  last  statistical  problem  which  should  be  mentioned 
deals  with  the  reliability  of  the  predictor  and  criterion 
scores.  The  SEQ  and  the  TBQ  were  found  to  have  remarkably 
reliable  factor  scores  given  that  each  factor  contained 
only  fifteen  items.  This  reliability  is  somewhat  mislead- 
ing, however,  in  that  the  reliability  of  a difference  score 
is  considerably  less  than  the  reliability  of  either  of  its 
component  scores  (Thorndike  and  Hagen,  1961) . This  problem 
exists  because  a difference  score  contains  the  total  error 
variance  of  its  component  scores  but  does  not  contain  the 
true  variances  which  they  have  in  common.  Thus,  difference 
scores  contain  a much  greater  ratio  of  error  variance  to 
true  variance  than  do  either  of  their  component  scores. 
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This  reduced  reliability  is  yet  another  factor  which  was 
likely  to  have  diminished  correlations  in  the  present  study. 

In  summary,  there  were  two  outstanding  problems  en- 
countered by  the  present  study  with  which  future  investiga- 
tors must  contend.  First  was  the  lack  of  experimental 
control  over  both  instructors  and  students.  College  profes- 
sors are  commonly  known  to  be  jealous  of  their  prerogatives 
as  to  what  goes  on  in  their  classrooms.  Yet  if  a study 
such  as  the  present  one  is  to  succeed,  it  will  have  to  gain 
either  better  instructor  cooperation  or  greater  adminis- 
trative control  so  that  the  times  and  conditions  under  which 
the  data  are  collected  can  be  made  more  uniform  and  generally 
suited  to  the  needs  of  the  study.  This  is  not  to  imply  that 
the  instructors  v/ho  participated  in  the  present  study  were 
uncooperative.  In  fact,  the  contrary  is  true.  In  most  cases 
they  were  quite  cooperative  and  in  some  cases  even  solicitous. 
The  point  being  made  is  that  this  type  of  study  requires  a 
substantial  amount  of  classroom  time  for  data  collection 
(sixty-five  minutes  in  three  separate  class  periods)  and 
this  much  of  a disturbance  is  more  than  most  instructors 
are  voluntarily  willing  to  tolerate.  Also,  the  investigator 
needs  to  be  in  better  control  of  the  announcements  and 
instructions  given  the  students  regarding  the  times  and 
purposes  for  which  the  data  is  being  collected.  Such  control 


66 


is  difficult  to  maintain  even  if  the  investigator  personally 
makes  all  of  the  announcements  directly  to  the  students  much 
less  if  he,  as  in  the  present  study,  gives  them  to  the  in- 
structor to  pass  on  to  the  students.  One  other  benefit  of 
better  expeimental  control  would  be  that  the  investigator 
would  be  able  to  use  a legitimate  random  process  in  the 
selection  of  classes  and  thereby  have  some  assurance  as  to 
the  representativeness  of  his  sample. 

The  second  outstanding  area  of  problems  with  which 
future  investigators  must  contend  is  the  statistical 
treatment  of  the  data.  The  basic  problem  lies  in  taking 
the  absolute  value  of  difference  scores  when  the  variance 
of  the  difference  scores  have  already  been  substantially 
reduced  by  the  use  of  other  procedures.  This  difficulty 
could  be  avoided  if  the  investigator  were  able  to  use  a 
theoretical  orientation  which  did  not  state  the  interaction 
between  student  characteristics  and  teacher  behavior  in 


terms  of  an  absolute  value  function. 
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LEADER  BEHAVIOR  DESCRIPTION  QUESTIONNAIRE; 
CONSIDEl^TION  AND  INITIATING  STRUCTURE 
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CONSIDERATION  KEY* 


Item 

Factor  loading 

He  does  personal  favors  for  crew  members 

CO 

CD 

• 

He  does  little  things  to  make  it  pleasant 
to  be  a member  of  the  crew 

.74 

He  is  easy  to  understand 

.69 

He  finds  time  to  listen  to  crew  members 

(—1 

CO 

* 

He  keeps  to  himself 

-.52 

He  looks  out  for  the  welfare  of  individual 
crew  members 

.70 

He  refuses  to  explain  his  actions 

-.77 

He  acts  without  consulting  the  crew 

-.62 

He  is  slovv  to  accept  new  ideas 

-.67 

He  treats  all  crew  members  as  his  equals 

1 — I 
00 

• 

He  is  willing  to  make  changes 

.74 

He  is  friendly  and  approachable 

.81 

He  makes  crew  members  feel  at  ease  when 
talking  with  him 

.74 

He  puts  suggestions  by  the  crew  into 
operation 

.67 

He  gets  crew  approval  on  important  matters 
before  going  ahead 

.63 

*A.  Halpin  and  B.  Winer , "A  factorial  study  of  the  leader 
behavior  descriptions,"  in  Leader  behavior:  Its  description 

and  measurement,  ed.  by  R.  Stogdill  and  A.  Coons  (Columbus, 
Ohio:  Ohio  State  University,  Bureau  of  Business  Research, 

1957)  , p.  47. 
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INITIATING  STRUCTURE  KEY* 

Item  Factor  loading 


He  makes  his  attitude  clear  to  the  crew 

.63 

He  tries  out  his  new  ideas  in  the  crew 

.62 

He  rules  with  an  iron  hand 

.61 

He  criticizes  poor  work 

.55 

He  speaks  in  a manner  not  to  be  questioned 

.47 

He  assigns  crew  members  to  particular  tasks 

.57 

He  works  without  a plan 

-.58 

He  maintains  definite  standards  of 
performance 

.75 

He  emphasizes  meeting  deadlines 

.48 

He  encourages  the  use  of  uniform  procedures 

' . 65 

He  makes  sure  his  part  in  the  crew  is 
understood  by  members 

.72 

He  asks  that  crew  members  follow  standard 
operating  procedures 

.60 

He  lets  crew  members  know  what  is 
expected  of  them 

.58 

He  sees  to  it  that  crew  members  are 
working  up  to  capacity 

.71 

He  sees  to  it  that  the  work  of  crew 
members  is  coordinated 

.60 

*A  Halpin  and  B-  Winer,  "A  factorial  study  of  the  leader 
behavior  descriptions,"  in  Leader  behavior:  Its  description 

and  measurement,  ed.  by  R.  Stogdill  and  A.  Coons  (Columbus, 
Ohio:  Ohio  State  University,  Bureau  of  Business  Research, 

1957) , p.  48. 
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Your  Identification  Mark 
Your  Instructor's  Kaine 


STUDENT  EXPECTATIONS  QUESTIONNAIRE 

By- responding  to  the  following  items,  describe  the  way  in  which  you  expect  the 
instructor  of  this  class  to  behave  during  the  coming  quarter.  Try  to  indicate 
the  level  of  behavior  which  you  feel  can  reasonably  be  expected  as  opposed  to 
that  which  you  might  ideally  expect. 

Indicate  the  frequency  with  which  you  expect  the  instructor  to  do  each  of  the 
things  lis.ted  below  by  circling  the  appropriate  letter. 

A.  Always 

B. '  Almost  always 

C.  Usually 

D.  . Occasionally 
e’.  Once  in  awhile 

F.  Rarely 

G.  Never.  • 


Example : 


© 

B 

c 

D 

E 

F 

G 

He 

will 

grade  .assignments  fairly. 

A 

B 

c 

D 

E 

F 

G 

1. 

He 

will 

do  personal  favors  for  class  members  who  have  problems. 

A 

B 

c 

D 

E 

F 

G 

2. 

He 

will 

make  his  personal  viewpoint  clear  to  the.class. 

A 

B 

c 

D 

E 

F 

G 

3. 

He 

will 

try  to  make  the  class  a pleasant  experience  for  the 

students 

A 

B 

c 

D 

E 

F 

G 

4. 

He 

will 

try  out  his  new  ideas  in  the  class. 

A 

B 

c 

D 

E 

F 

G 

5. 

Ha 

will 

be. easy  to  understand. 

A 

B 

c 

D 

E 

F 

G 

6. 

He 

will 

rule  with  an  iron  hand. 

A 

B 

c 

D 

E 

F 

G 

7. 

He 

will 

find  time  to  listen  to  class  members'  problems. 

A 

B 

c 

D 

E 

F 

G 

-8. 

He 

will 

make  constructive  criticisms  of  poor  work; 

A 

B 

c 

D 

E 

F 

G 

9. 

He 

will 

be  distant  and  impersonal  in  his  dealings  with  students. 

A 

B 

c 

D 

E 

F 

G 

10. 

. He 

will 

speak .in  a manner  not  to  be  questioned. 

A 

B 

c 

D 

E 

F 

G 

11. 

He 

will 

show  interest  in  the  welfare  of  individual  class  members. 

A 

B 

c 

D 

E 

F 

G 

12. 

He 

will 

give  class  members  specific  v.rork  assignments. 

A 

B 

c 

D 

E 

F 

G 

13. 

He 

will 

refuse  to  explain  his  actions  to  class  members. 

A 

B 

c 

D 

E 

F 

G 

14. 

He 

will 

work  without  a plan. 

A 

B 

c 

D 

E 

F 

G 

15. 

He 

will 

make  changes  in  class  routines  without  consulting  the 

class. 

A 

B 

c 

D 

E 

F 

G 

16. 

He 

will 

maintain  definite  standards  of  academic  performance. 

A 

B 

c 

D 

E 

F 

G 

17. 

He 

will 

be  slow  to  accept  new  ideas  from  the  class. 

A 

B 

c 

D 

E 

F 

G 

18. 

He 

will 

emphasize  meeting  deadlines. 

A 

B 

c 

D 

E 

F 

G 

19. 

He 

will 

treat  class  members  as  his  equals. 

A 

B 

c 

D 

E 

F 

G 

20. 

He 

will 

require  the  use  of  a standard  style  in  written  assignments. 

A 

B 

c 

D 

E 

F 

G 

21. 

He 

will 

be  willing  to  make  changes. 

A 

B 

c 

D 

E 

F 

G 

22. 

He 

will 

make  sure  that  his  role  in  class  activities  is  understood. 

A 

B 

c 

D 

E 

F 

G 

23. 

He 

will 

be  friendly  and  approachable. 

A 

B 

c 

D 

E 

F 

G 

24. 

He 

will 

ask  that  class  members  conform  to  applicable  university 

. 

regulations . 

A 

B 

c 

D 

E 

F 

G 

25. 

He 

will 

make  class  members  feel  at  ease  when  talking  with  him* 

A 

B 

c 

D 

E 

F 

G 

26. 

He 

will 

let  class  members  know  what  is  expected  of  them* 

A 

B 

c 

D 

E 

F 

G 

27. 

He 

will 

make  use  of  suggestions  made  by  class  members. 

A 

B 

c 

D 

E 

F 

G 

28. 

He 

will 

require  class  members  to  make  their  best  effort  on 

assignments. 

A 

B 

c 

D 

E 

F 

G 

29. 

He 

will 

seek  class  approval  on  important  matters  before  going  ahead. 

A 

B 

c 

D 

E 

F 

G 

30. 

He 

will 

require  the  work  of  class  members  to  be  on  schedule. 

Answer  the  following  -two  questions  by  circling  YES  or  NO. 


YES  NO  Arc  you  aware  of  having  taken  any  previous  courses  under  this 

instructor?  • 

YES  NO  DO  you  have  any  knowledge  of  how  this  instructor  conducts  his 

classes? 
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Your  Identification  Mark 
Your  Instructor's  Name 


TEACHER  BEHAVIOR  QUESTIONNAIRE 

By  responding  to  the  following  items,  describe  the  behavior  of  your  instructor.  Try 
to  be  as  objective  as  possible. 

Indicate  the  frequency  with  which  your  instructor  does  each  of  the  things  listed 
below  by  circling  the  appropriate  letter. 

A.  Always 

B.  Almost  always 

C.  Usually 

D.  Occasionally 

E.  Once  in  av/hile 

F.  Rarely 

G.  Never 


Example: 


0 

B 

C 

D 

E 

F 

G 

He 

attends  class  meetings. 

A 

B 

C 

D 

E 

F 

G 

1. 

He 

does  personal  favors  for  class  members  who  have  problems. 

A 

B 

C 

D 

E 

F 

G 

2. 

He 

makes  his  personal  viewpoint  clear  to  the  class. 

A 

B 

C 

D 

E 

F 

G 

3. 

He 

tries  to  make  the  class  a pleasant  experience  for  the  students. 

A 

'a 

C 

D 

E 

F 

0 

■A  . 

He 

tries  out  his  new  ideas  in  the  class. 

A ' 

B 

C 

D 

E 

F 

G 

5. 

He 

is  easy  to  understand. 

A 

B 

C 

D 

E 

F 

G 

6. 

He 

rules  with  an  iron  hand. 

A 

B 

c 

D 

E 

F 

G 

7. 

He 

finds  time  to  listen  to  class  members'  problems. 

A 

3 

c 

D 

E 

F 

G 

8. 

He 

makes  constructive  criticisms  of  poor, work. 

A 

B 

c 

D 

E 

F 

G 

9. 

He 

is  distant  and  impersonal  in  his  dealings  with  students. 

A 

6 

c 

D 

E 

F 

G 

\o. 

He 

speaks  in  a manner  not  to  be  questioned. 

A 

B 

c 

D 

e' 

F 

G 

11. 

He 

shows  interest  in  the  welfare  of  individual  class  members. 

A 

B 

c 

D 

E 

F 

G 

12. 

He 

gives  class  members  specific  work  assignments. 

A 

B 

c 

D 

E 

F 

G 

13-. 

He 

refuses  to  explain  his  actions  to  class  members. 

A 

B 

c 

D 

E 

F 

G 

14. 

He 

works  without  a plan. 

A 

B 

c 

D 

E 

F 

G 

15. 

He 

makes  changes  in  clas.s  routines  without  consulting  the  class. 

A 

D 

c 

n 

E 

F 

G 

16. 

He 

maintains  definite  standards  of  academic  performance. 

A 

B 

c 

D 

E 

F 

G 

17. 

He 

is  slow  to  accept  new  ideas  from  the  class. 

A 

B 

c 

D 

E 

F 

G 

18. 

He 

emphasizes  meeting  deadlines. 

A 

B 

c 

D 

E 

F 

G 

19. 

He 

treats  class  members  as  his  equals. 

A 

B 

c 

D 

E 

F 

G 

20. 

He 

requires  the  use  of  a standard  style  in  written  assignments. 

A 

B 

c 

D 

E 

F 

G 

21. 

He 

is  willing  to  make  changes. 

A 

B 

c 

D 

E 

F 

G 

22. 

He 

makes  sure  that  his  role  in  class  activities  is  understx>od. 

A 

B 

c 

D 

E 

F 

G 

23. 

He 

is  friendly  and  approachable. 

A 

B 

c 

D 

E 

F 

G 

24. 

He 

asks  that  class  meirbers  conform  to  applicable  univer"sity 

regulations. 

A 

B 

c 

D 

E 

F 

G 

25. 

He 

makes  class  members  feel  at  ease  when  talking  with  him. 

A 

B 

c 

D 

E 

F 

G 

26. 

He 

lets  .class  members  know  what  is  expected  of  them. 

. A 

B 

c 

D 

E 

F 

G 

27. 

He 

makes  use  of  suggestions  made  by  class  members. 

A 

B 

c 

D 

E 

F 

G 

28. 

He 

requires  class  members  to  make  their  best  effort  on  assignments. 

A 

B 

c 

D 

E 

F 

G 

29. 

He 

seeks  class  approval  on  important  matters  before  going  ahead. 

A 

B 

c 

D 

E 

F 

G 

30. 

He 

requires  the  work  of  class  members  to  be  on  schedule. 

APPENDIX  C 


STUDENT  EVALUATION  OF  TEACHING  BEHAVIORS 
INSTRUMENT  INCLUDING  ITEM 
WEIGHTS  USED  FOR  SCORING 
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STUDENT  evaluation  OF  COLLEGE  TEACHING  BEHAVIORS 


Introduction 


Faculty  and  Students  are  giving  increasing  attention  to 
the  improvement  of  instruction.  This  instrument  has  been 
designed  to  describe  teaching  behavior  in  which  your  instruc- 
tor has  engaged  in  this  course. 

You  are  asked  to  give  honest  answers  to  the  questions 
appearing  on  the  attached  pages.  please  do  not  write  on 
this  form.  An  answer  sheet  has  been  provided.  The  answer 
sheets  are  not  to  be  signed.  The  results  will  be  tabulated 
by  graduate  assistants  in  the  Research  Center  of  the  College 
of  Education.  Summaries  of  the  results  will  be  furnished  to 
the  instructor  only  after  final  grades  have  been  turned  in. 

Directions 

Listed  below  are  statements  describing  teaching  behaviors 
that  the  instructor  in  this  course  may  or  may  not  have  dis- 
played. Some  of  the  teaching  behaviors  described  are  related 
to  "good"  college  teaching,  and  som.e  are  related  to  "bad" 
college  teaching.  All  items  are  not  necessarily  appropriate 
to  all  courses  and/or  all  instructors. 

As  you  examine  each  item,  you  must  decide  whether  the 
behavior  described  is  relevant  to  your  learning  in  this  parti- 
cular classroom.  Mark  the  item  as  follows: 

a.  If  the  item  is  not  relevant  (does  not  apply)  to 
this  course,  leave  the  item  blank. 

b.  Circle  1 if  you  consider  the  item  to  be  relevant 
and  it  describes  the  behavior  of  the  instructor  in 
this  class. 

c.  Circle  2 if  you  consider  the  item  to  be  relevant 
and  it  does  not  describe  the  behavior  of  the 
instructor  in  this  class. 

1.  Admitted  lack  of  knowledge. 

2.  Told  students  what  he  expected  of  them. 

3.  Gave  organized  answers  to  complicated  questions  in 
class . 
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4.  Changed  pitch,  volume  or  quality  of  speech. 

5.  Would  not  deal  with  questions  covering  material  beyond 
text . 

6.  Called  often  upon  relevant  personal  experiences  in 
teaching  subject. 

7.  Missed  class  often  due  to  non-teaching  responsibilities. 

8.  Permitted  students  to  disrupt  classroom  activities. 

9.  Permitted  students  to  express  opinions  which  differed 

from  his  own. 

10.  Tested  primarily  for  isolated  and/or  obscure  detail.s. 

11.  Dealt  with  questions  covering  material  beyond  text. 

12.  Encouraged  students  to  ask  questions. 

13.  Introduced  new  ideas  and/or  research  findings  in  class. 
]4.  Gave  references  to  current  publications. 

15.  Explained  how  grading  was  done. 

16.  Provided  feedback  on  student  work  promptly. 

17.  Ridiculed  students  in  front  of  class. 

18.  Could  be  heard  in  all  parts  of  classroom. 

19.  Presented  material  as  an  extension  of  the  text. 

20.  Students  could  understand  professor's  vocabulary. 

21.  Spoke  with  poise. 

22.  Students  could  understand  class  presentation. 

23.  Penalized  students  for  disagreeing  with  teacher. 

24.  Listened  to  students'  problems. 

25.  Presented  obsolete  material. 
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26.  Ignored  student  questions. 

27.  Dealt  with  student  difficulties  before  they  arose. 

28.  Showed  boredom  for  teaching  this  class. 

29.  Admitted  being  wrong  when  shown  he  was  in  error. 

30.  Talked  with  students  outside  of  class. 

31.  Laughed  at  his  own  mistakes. 

32.  Frequently  read  aloud  from  the  textbook. 

33.  Established  and  kept  office  hours  for  individual  con- 
ferences . 

34.  Gave  tests  which  could  be  completed  within  the  allotted 
time . 

35.  Accepted  and/or  used  inaccurate  information. 

36.  Presented  facts  without  relating  them  to  one  another. 
57.  Gave  clear,  reasonable  assignments. 

38.  Utilized  background  of  students  to  aid.  in  class 
activities . 

39.  Informed  students  of  reports  and  term  papers  at  the 
beginning  of  the  course. 

40.  Class  presentations  were  primarily  reiterates  of  text- 
book . 

41.  Asked  challenging  and/or  probing  questions. 

42.  Remained  unruffled  by  student's  questions. 

43.  Stated  course  objectives. 

44.  Complained  about  his  teaching  assignments. 

45.  Was  late  to  class. 

46.  Lead  students  to  answer  own  questions. 
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47.  Insisted  that  his  opinions  were  the  only  correct  ones. 

48.  Read  extensively  from  his  lecture  notes. 

49.  Permitted  students  to  complete  thought  processes. 

50.  Spoke  distinctly. 

51.  Encouraged  class  discussion. 

52.  Lacked  knowledge  of  subject  being  presented. 

53.  Stated  basis  by  which  grades  were  determined. 

54.  Explained  the  reasons  for  his  criticisms. 

55.  Announced  exams  in  advance. 

56.  Delivered  orderly,  logical  presentations  of  the  material. 

57.  came  to  class  and  appointments  on  time. 

58.  Made  no  comment  (oral  or  written)  on  returned  papers. 

59.  Presented  irrelevant  material  during  lectures. 

60.  Evaluated  each  student  as  an  individual. 
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Instructor's  Name 


Course  Number 


Answer  Sheet 

STUDENT  EVALUATION  OF  COLLEGE  TEACHING  BEHAVIORS 

DIRECTIONS:  Before  beginning,  please  fill  in  the  following 

information.  Use  the  number  which  corresponds  to  your  answer. 


Your  present  college  standing: 


(1) 

Freshman 

(4) 

Senior 

(2) 

Sophomore 

(5) 

Graduate 

(3) 

Junior 

(6) 

Other 

(1) 

Male 

(2) 

Female 

College  in  which  you  are  currently  enrolled: 


(01) 

Agriculture 

(10) 

Law 

(02) 

Architecture  & Fine  Arts 

(11) 

Medicine 

(03) 

Arts  & Sciences 

(12) 

Military  Science 

(04) 

Business  Administration 

(13) 

Nursing 

(05) 

Dentistry 

(14) 

Pharmacy 

(06) 

Education 

(15) 

Physical  Education 

(07) 

Engineering 

Health  & Athletics 

(08) 

Health  & Related  Professions 

(16) 

University  College 

(09) 

Journalism  & Communications 

(17) 

Unknown 

Your  over-all  grade  average: 


(1) 

A 

(4) 

B 

(7) 

C 

(2) 

A- 

(5) 

B- 

(8) 

C- 

(3) 

B+ 

(6) 

C + 

(9) 

D+ 

(10) 

D or  below 

for 

taking 

this 

course : 

(1)  Required  (2)  Elective  (3)  Other 
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1. 

1 

2 

21. 

1 

2 

41. 

1 

2. 

1 

2 

22. 

1 

2 

42. 

1 

3. 

1 

2 

23. 

1 

2 

43. 

1 

4. 

1 

2 

24. 

1 

2 

44. 

1 

5. 

1 

2 

25. 

1 

2 

45. 

1 

6. 

1 

2 

26. 

1 

2 

46. 

1 

7. 

1 

2 

27. 

1 

2 

47. 

1 

8. 

1 

2 

28. 

1 

2 

48. 

1 

9. 

1 

2 

29. 

1 

2 

49. 

1 

10. 

1 

2 

30. 

1 

2 

50. 

1 

11. 

1 

2 

31. 

1 

2 

51. 

1 

12. 

1 

2 

32. 

1 

2 

52. 

1 

13. 

1 

2 

33. 

1 

2 

1 

53. 

1 

14. 

1 

2 

34. 

1 

2 

54. 

1 

15. 

1 

2 

35. 

1 

2 

55. 

1 

16. 

1 

2 

36. 

1 

2 

56. 

1 

17. 

1 

2 

37. 

1 

2 

57. 

1 

18. 

1 

2 

38. 

1 

2 

58. 

1 

19. 

1 

2 

39. 

1 

2 

59. 

1 

20. 

1 

2 

40. 

1 

2 

60. 

1 

If  you 

had 

to 

assign  the  instructor 

of 

' this 

course  a letter 

grade 

for 

his 

teaching,  how 

would  you 

grade 

him 

(her) ? 

Pleas 

circle 

the 

grade  of  your  choice. 

(1)  A 

(4) 

B (7)  C 

(10) 

D 

or  below 

(2)  A 

- 

(5) 

B-  (8)  C- 

(3)  B+ 

(6) 

C+  (9)  D + 

2 

2 

2 

O 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

e 
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ITEM  WEIGHTS  FOR  TBI 


1. 

0.0124 

2. 

0.8938 

3. 

0.7548 

4. 

0.3747 

5. 

-0.1363 

6 . 

0.7563 

7. 

-0.5267 

8. 

-0.0641 

9. 

0.3694 

10. 

-1.2336 

11, 

0.3245 

12. 

1.6044 

13. 

2.3467 

14. 

0.7640 

15. 

0.4035 

16. 

0.4503 

17. 

-0.5683 

18. 

0.5761 

19. 

0.2639 

20. 

0.7152 

21. 

0.2589 

22. 

2.6009 

23. 

-2.9067 

24. 

1.0184 

25. 

-0.2425 

26. 

-0.6040 

27. 

0.1793 

28. 

-0.1954 

29. 

0.0610 

30. 

0.6136 

31. 

0.3032 

32. 

-0.7574 

33. 

1.1104 

34. 

1.3152 

35. 

-0.2761 

36. 

-0.1087 

37. 

1.0842 

38. 

0.2705 

39. 

0.1439 

40. 

-0.6348 

41. 

0.3894 

42. 

0.1657 

43. 

0.7053 

44. 

-0.1032 

45. 

-0.5996 

46. 

0.3338 

47. 

-1.5217 

48. 

-1.3356 

49. 

0.2922 

50. 

0.9459 

51. 

2.1531 

52. 

-1.7066 

53. 

0.0171 

54. 

0.6906 

55. 

2.2290 

56. 

0,1944 

57. 

0.8536 

58. 

-0.6791 

59. 

-0.8163 

60. 

0.8074 

APPENDIX  D 


STUDENT  REPORT  ON  CLASSROOM 
TEACHING  INSTRUMENT 
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STUDENT  REPORT  ON  CLASSROOM  TEACHING 

Form  A 


The  faculty  of  the  College  of  Education  is  seeking  con- 
stantly to  improve  the  quality  of  its  instructional  program. 
You  as  a student  can  assist  by  giving  your  reaction  to  the 
type  of  instruction  which  you  have  experienced  in  this  class. 
Individual  faculty  members  for  years  have  been  seeking 
students'  evaluations  of  their  teaching  procedures.  In 
1961-1962  the  faculty  selected  a uniform  blank  which  was 
tried  out  in  many  classes.  This  is  a revision  of  that  form. 

You  are  asked  to  give  honest  and  sincere  answers  to  the 
questions  on  the  attached  blanks . The  blanks  are  not  to  be 
signed.  Answers  will  be  tabulated  by  computer  through  the 
research  center  of  the  College  of  Education  and  the  summaries 
of  the  replies  will  be  furnished  the  instructor.  Instructors 
will  not  see  the  results  until  grades  are  turned  in. 

Your  reactions  and  suggestions  about  the  work  of  this 
class  will  be  appreciated  and  will  serve  as  one  basis  for 
future  planning. 

t 

Please  do  not  write  on  this  form.  An  answer  sheet  will 
provided. 


DIRECTIONS 

Select  the  one  descriptive  phrase  under  each  item  which 
best  describes  your  instructor  or  his  teaching  and  circle  the 
corresponding  number  on  the  answer  sheet.  Do  not  consult 
with  classmates;  make  your  own  ratings.  Do  not  sign  your 
name . 

Questions 


1.  How  would  you  rate  your  instructor  in  general  (all- 
around)  teaching  ability? 

1.  An  outstanding  and  stimulating  instructor 

2.  A very  good  instructor 

3.  A good  instructor 

4.  An  adequate,  but  not  stim.ulating  instructor 

5.  A poor  and  inadequate  instructor 


How  well  does  the  instructor  adapt  the  course  to  your 
level  of  comprehension? 

1.  Nearly  always  adjusts  to  my  level 

2.  Usually  adjusts  to  my  level 

3.  Adjusts  to  my  level  more  often  than  not 

4.  Adjusts  to  my  level  about  half  of  the  time 

5.  Seldom  adjusts  to  my  level 

6.  Is  lower  than  my  level 

7.  Does  not  apply  to  this  course 

How  interesting  (or  stimulating)  does  he  make  the 
material? 

1.  One  of  the  most  interesting  teachers  I have  had 

2.  Above  average  in  creating  interest 

3.  Just  about  average 

4.  Less  interesting  than  most  teachers 

5.  Material  is  dull,  one  of  the  m.ost  boring  ex- 
periences I have  had 

6.  Does  not  apply  to  this  course 

How  well  does  he  seem  to  know  the  subject? 

1.  Thorough  and  profound  scholarship 

2.  Knowledge  broad  and  accurate 

3.  Well-rounded  knowledge  of  the  subject 

4.  Adequate  knowledge 

5.  Inadequate  knowledge 

6.  Does  not  apply  to  this  course 

What  kind  of  interest  does  he  show  in  students  and 
student  problems? 

1.  Actively  seeks  student  opinions,  respects  con- 
fidences, and  helps  students  arrive  at  satisfy- 
ing solutions. 

2.  Permits  students  to  express  opinions  and  raise 
problems  which  are  of  concern  to  them. 

3.  Tolerates  student  opinions  but  has  an  attitude 
which  discourages  frankness  and  openness  from 
students . 

4.  Displays  little  interest  in  student  problems  or 
opinions ; hard  to  talk  with 

5.  Appears  to  be  antagonistic  to  students  and  student 
problems 

6.  Does  not  apply  to  this  course 
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6.  How  efficient  is  he  in  the  use  of  time? 

1.  Classes  show  evidence  of  careful  planning  and  very 
efficient  use  of  time 

2.  He  is  above  average  in  efficient  use  of  class 
time 

3.  This  is  about  an  average  class  in  efficient  use  of 
time 

4.  I have  a feeling  that  we  are  often  wasting  time 

5.  The  teacher  wastes  much  time  and  makes  poor  use 
of  the  rest 

6.  Does  not  apply  to  this  course 

7.  How  clear  are  the  goals  in  this  class? 

1.  I have  known  from  the  beginning  what  we  were  ex- 
pected to  get  from  the  course  and  I can  see  the 
relation  of  what  we  are  doing  to  these  goals 

2.  The  goals  are  clear  but  sometimes  it  is  hard  to 
see  how  what  we  are  doing  contributes  toward  these 
goals 

3.  The  goals  of  the  course  are  about  as  clear  as  in 
the  average  course 

4.  I am  beginning  to  see  what  our  goals  are  but  I was 
confused  for  a long  time 

5.  I don't  know  what  v/e  are  supposed  to  achieve  in 
this  class 

6.  Does  not  apply  to  this  course 

8.  How  clearly  are  responsibilities  in  this  course  defined? 

1 . I always  know  what  is  expected  of  me 

2.  I usually  know  what  is  expected  of  me 

3.  I usually  have  a general  idea  of  what  is  expected 
of  me 

4.  I often  am  in  doubt  about  what  is  expected  of  me 

5.  I seldom  know  what  is  expected  of  me 

6.  Does  not  apply  to  this  course 

9.  Do  you  feel  that  you  are  able  to  get  personal  help  in 

this  course  if  you  need  it? 

1.  Can  get  a great  deal  of  personal  help  from  the 
instructor  or  assistants 

2.  Can  get  quite  a bit  of  personal  help 

3.  Can  get  a moderate  amount  of  help 

4.  Can  get  a small  amount  of  help 


10. 


11. 


12. 


86 


5.  Can  get  no  personal  help  from  the  instructor  or 
assistants 

6.  Does  not  apply  to  this  course 
Are  the  grading  policies  fair? 

1.  Unusually  or  exceptionally  fair 

2.  Fairer  than  most 

3.  As  fair  as  the  average  instructor's  policies 

4.  Unfair  to  some 

5.  Unfair  to  many 

6.  Doesn't  know  what  they  are 

7.  Does  not  apply  to  this  course 

How  helpful  are  the  evaluation  procedures  used? 

1.  Very  helpful  in  assessing  progress  toward  our 
goals 

2.  Of  more  than  average  help  in  assessing  progress 

3 . About  average 

4.  Of  little  help 

5.  Of  no  help 

6.  We  do  not  use  any,  as  far  as  I can  tell 

7.  Does  not  apply  to  this  course 

How  much  does  he  encourage  original  and  creative 
thought  by  students? 

1.  Strongly  encourages  students'  attempts  to  be 
original 

2.  Mildly  encourages  students'  attempts  to  be 
original 

3.  Permits  students  to  differ  with  text  and  instructor 

4.  Has  a condescending  attitude  toward  what  students 
may  consider  original  but  which  has  been  discovered 
by  others 

5.  Humiliates  students  for  immaturity  of  ideas  and 
lack  of  knowledge  of  the  field 

6.  Does  not  apply  to  this  course 


INSTRUCTOR'S  NAME 


COURSE  NUMBER 


ANSWER  SHEET 

STUDENT  REPORT  ON  CLASSROOM  TEACHING 

Form  A 


Date 

DIRECTIONS:  IN  THE  BLANK  TO  THE  RIGHT  OF  EACH  CATEGORY, 

PLACE  THE  NUMBER  FOR  YOUR  CHOICE 


Your  present  college  standing 

1. 

Freshman 

4.  Senior 

2. 

Sophomore 

! 5.  Graduate 

3. 

Junior 

6.  Other 

Your  over-all  undergraduate 

01 

. A 

04.  B 

u 

• 

o 

grade  average : 

02 

. A- 

- 05.  B- 

08.  C- 

03 

. B+  06.  C + 

09.  D + 

10.  D or  below 

An  estimate  of  your  current 

1. 

A 

3 . C 5 . 

F 

grade  in  this  course: 

2. 

B 

4.  D 6. 

Unknown 

College  of  the  University  in  which  you  are  registered: 

1.  Education  3.  Health  and  Related  Services 

2.  Arts  and  Sciences  4.  Physical  Education 

5.  Other 

Sex:  1.  Male  2,  Female 


Why  did  you  take  this  course: 

1.  Required  2.  Elected  3.  Other 
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DIRECTIONS:  1, 


2. 


CIRCLE  THE  NUMBER  FOR  YOUR  CHOICE  ON  EACH  OF 
THE  RATING  ITEMS,  AND 

ENTER  THIS  NUMBER  IN  THE  ANSWER  BLANK  TO  THE 
RIGHT  OF  THE  ITEM. 


Item  No. 

1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 

11. 

12. 


Choices 


1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 


2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 

2 


3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 

3 


4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 


5 

5 

5 

5 

5 

5 

5 

b 

5 

5 

5 

5 


6 

6 

6 

6 

6 

6 

6 

6 

6 

6 

6 


7 

7 


Answer 


APPENDIX  E 


LISTS  OF  THE  FORTRAN  PROGRAMS 
PSEQTBQ,  PTBI,  AND  PCEI 


NAME  OF  PROGRAM  = PSEQTBQ 

REVERSE,  TOTAL,  AND  PUNCH  SEQ  AND  TBQ  FACTOR  SCORES 

PROGRAM  WRITES  SEQ  AND  TBQ  DATA  ON  SEPERATE  CARDS  (FOR  REGRESSED  GAIN  INPUT) 
DIMENSION  SR  (50, 60)  , ID  (50,2)  ,SUM(60)  ,AVE(60) 
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160  CONTINUE 

WRITE  (6,421)  (ID(I,  J)  , J=l,2)-,  (SR(I,  J)  , J=l,60) 
421  FORMAT (IX, I4 , 2X, l2 , 3X, 30F2 . 0/12X, 30F2 . 0) 

WRITE  (7,124)  (ID(I,  J)  , J=l,2)  , (SR(I,  J)  , J=l,60) 
124  FORIvIAT  (I4,2X,I2,3X,30F2.0/12X,30F2.0) 


125  CONTINUE 

WRITE (6, 154)  NUM,N 
154  FORMAT (IX, I4, lx, I2) 
DO  41  1=1, N 
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DO  30  J=31,59,2 
30  TC=TC+SR(I,  J) 

OTAL  EVEN  ITEMS  OF  TBQ  ("INITIATING  STRUCTURE"  OBSERVED  BY  STUDENT) 
DO  40  J=32, 60,2 


40  TI=TI+SR(I,J) 

WRITE  (6,43)  (ID(I,J)  ,J=1,2)  ,SC,SI,  ID  (I,  1)  ,TC,TI 

43  FORMAT (1X,I4,2x,I2,3X,2F8.3/1X,I4, 7X,2F8.3) 
WRITE  (7,44)  (ID(I,  J)  ,J=1,2)  , SC , SI , ID  (1 , 1)  ,TC,TI 

44  FORMAT ( I4 , 2X, I2 , 3X, 2f8 . 3/l4 , 7X, 2F8 . 3) 
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NAME  OF  PROGRAM  = PTBI 

THIS  PROGRAM  COMPUTES  AND  PUNCHES  THE  3 FACTOR  SCORES  FOR  THE  TBI  INSTRUMENT 
ODIMENSION  FTVTS  (60)  ,SERS  (60)  ,Rl  (14)  ,R2  (10)  ,R3  (9)  ,R4  (8)  ,R5  (5)  , 

1R6(5)  ,R7(5)  ,R8(4)  ,FRl(14)  ,FR2(10)  ,FR3(9)  ,FR4(8)  ,FR5(5)  ,FR6(5)  , 

2FR7(5)  ,FR8(4)  ,PU(8)  ,SU(50.8)  ,NU(50)  ,XGRA(50)  ,SUM(8)  ,AVE(8) 
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FR2  (8)  =FWTS  (54) 
FR2  (9)  =FWTS  (58) 
FR2  (10)  =FWTS  (60) 
FR3  (1)  =FWTS  (2) 
FR3 (2) =FWTS (15) 


94 


m 

cn 

m 

oo 

ID 

o 

1 — 1 

CN 

CD 

CD 

(Ti 

t— 1 

ro 

CO 

CO 

o 

O 

m 

n 

00 

uo 

in 

ro 

CN 

CN 

CN 

CN 

00 

in 

in 

\D 

rH 

rH 

rH 

in 

1—1 

ro 

in 

O' 

CD 

'll* 

‘ — 

^ — ■' 

> — ' 

' — 

v.^ 

- — 

• — ' 

^ — ' 

'w' 

■■ — ' 

■ — ' 

' — ^ 

•w ^ 

'w»' 

— 

^ — ' 

'■ — 

' — ' 

CO 

CO 

CO 

CO 

cn 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

CO 

Eh 

Eh 

Eh 

EH 

Ph 

F^ 

Ph 

Eh 

Ph 

EH 

Eh 

Eh 

Eh 

Eh 

Eh 

EH 

& 

& 

g 

s 

s 

IS 

& 

& 

& 

& 

[2 

& 

& 

2 

& 

Pn 

plH 

[X| 

Cm 

Pm 

w 

Pm 

Pm 

Pm 

Cm 

Pm 

Pm 

Pm 

Cm 

Cm 

E 

Pm 

Pm 

Pm 

Cm 

Pm 

Pm 

Pm 

Pm 

Ph 

II 

II 

II 

II 

11 

II 

11 

11 

II 

II 

II 

11 

II 

II 

II 

II 

11 

11 

II 

II 

II 

II 

II 

II 

II 

II 

ti 

II 



, 

^ 

, — , 



.»— <» 

, — , 

^ 

» 



, 

s. 

,, — s. 

,, — ^ 

y— s 

y— «, 

— . 

, — ^ 

m 

lO 

c£> 

CO 

(T» 

rH 

CN 

cn 

m 

CD 

r- 

CO 

r-M 

CN 

ro 

in 

1—1 

CN 

ro 

'd' 

in 

f— 1 

CN 

oo 

'w' 

■ — ' 

'w' 

'w*' 

'w-' 

' — ' 

' — ^ 

'w' 

■ — 

*S— «' 

'w«' 

'w' 

N.— ' 

'w' 

■ — 

^ ^ 

>.«✓ 

♦w' 

ro 

m 

m 

00 

m 

00 

ro 

m 

in 

in 

in 

in 

CD 

KO 

CD 

CD 

CD 

r- 

ct; 

cc: 

0^ 

0^ 

Plj 

Pi 

cri 

Pi 

Pi 

Pi 

p:J 

p^ 

cc; 

P£| 

P^ 

P^ 

Pi 

Pi 

P^ 

P^ 

Pi 

Cm 

Cm 

Cm 

Pn 

Cm 

Pm 

Cm 

Cm 

Pm 

Cm 

Pm 

Cm 

Pm 

Cm 

Pm 

Cm 

Cm 

Cm 

Cm 

Cm 

Pm 

Cm 

Cm 

Pm 

Pm 

Cm 

Cm 

Pm 

FR7  (4)  =FWTS  (45) 
FR7  (5)  =FWTS  (57) 
FR8(1)  =FWTS  (28) 
FR8 (2) =FWTS (32) 
FR8  (3)  =FWTS  (40) 


95 


00 

B 

o 

w 

H 

r— I 


CO 

g 

H 

U 

< 

Pm 


O 

H 

W 

Eh 


CO 

§ 


Pm 

O 

CO 


O 

VO 

rH  O 

II  • 
H CN 
' Pm 

"h  X 

— ' n 


< 

CO 

U 

CO 

P4 

o 

w 

• 

EH 

CO 

!3 

CO 

iH 

13 

P3 

— ^ 

p 

P4 

O 

(N 

•r 

o 

CO 

(4 

5 

H 

Q 

VD 

CO 

!3 

H 

* 

— 

Eh 

P4 

X 

X 

CO 

CO 

Pd 

rH 

— . 

rH 

EH 

r-H 

o 

5 

o 

o 

o 

■Vt 

Pm 

a 

CM 

H 

CM 

H 

II 

H 

P4 

Q 

' — ' 

1 — 1 

O 

in 

m 

EH 

+ 

O II 

5" 

§ 

5 

v.^ 

1 

- — ' 

U 

il  s 

w 

EH 

p 

o 

Q 

S 

H 

S 2 

00 

od 

CO 

C 

2 

II 

p4 

II 

P p 

p4 

W 

o 

u 

W 

O 

u 

p w 

Pm 

a 

(4 

p4 

p 

H 

Pd 

Pm 

H 

X P 

H 

D 

n^LovDCTii— ifO'^'vt'^mocN 

CNCNCNCNCNrO'-^' — — ' — r-HiH 

^ (/)  yj  CO'-'””' 
cocococococopilc4(4PiJp^coco 
p^pi^PiOiprJpiPiqpilPiqMiyp^p^ 
WWpqWPOlilcococococoiyPi^ 

CO  CO  CO  CO  CO  CO  II  >1  V?  V 

II  II  II  II  II  II  ^ ^ ^ ^ ^ II  II 

rH  CM  n ^ 

I— ICMCO'^irivDr^CDCrii— ItHi-HiHiHiHCM 

I— It— ItHi-Ht-HrHiHrHiHr-HrHiHr-IrHCMCM 

Ct^piio:^px:c4p:p:p5p4pc:ci:cc:pip:oi(4 


cn  r-H 

CO  CO 
(4  C4 
a P4 

CO  CO 

II  II 


C3  O 
PJ  (4 
CO  O 


CTi 

o 

pH 


on  o 
CTi  o 
CM 


u u 


o 

CM 


96 


, . 

O 

VD 

CO 

rM 

VD 

r~-{ 

CO 

CD 

in 

CO 

1 — 1 

m 

S- 

in 

in 

m 

— 

CN 

t-H 

cn 

v_^ 

' — ■ 

CO 

' — 

^ ^ 

cn 

in 

in 

CO 

CO 

in 

CO 

Pi 

CO 

CO 

CO 

oi 

Pi 

Pi 

Pi 

Pi 

0^ 

Pi 

w 

Pi 

Pi 

w 

w 

w 

w 

w 

w 

w 

CO 

w 

w 

W 

C/D 

in 

in 

in 

CO 

in 

in 

II 

in 

CO 

CO 

II 

II 

II 

II 

II 

II 

II 

II 

II 

11 

^ — _ 

, — , 

„ — . 

^ — 

, — ^ 

o 

^ 

n 

IT) 

VD 

CO 

CTi 

i“H 

tH 

CN 

CO 



— ^ 

■ — ' 

■ — ■ 

' — ^ 

' — 

'' — ■ 

cs 

(N 

tN 

CM 

CN 

CN 

CN 

CN 

00 

oo 

CO 

Pi 

Pi 

Pi 

Pi 

Pi 

Pi 

Pi 

Pi 

Pi 

Pi 

nrom'^finiTinrsicN 

wtnoicowcococnco 
piP^CrJpifrJpitiJPHPH 
WPqWWHWWWW 
cocnwoicowwuico 
II  II  II  II  II  II  II  II  II 


<^m'X)r^oocrir-ir'iro 


ronronroro'^j''^'^ 

p^O^lPipclpiPiP^PiCti 


CNr^VD'-DCri^iHrO'^CTi— .^COO 

CNCNniniOVDiHtHrHi-H'^LOi— 100 

WC/JCOtOCOCOOlUiWWCOCOWCO 
CdP^CtJCcICclPiDiD^DiDiP^pipipH 
HWWWMMMWMWWWWW 
c/jtncocnwwtocnwcocooiww 
II  II  II  II  II  II  II  II  II  II  II  II  II  II 

^in'^r'CX)'-tcNn';t'inrH<Nn^ 

Pt5pc;cr;pc;pip^rtpc:i^o^p^pii^(^ 


R6(5)  =SERS  (50) 
R7(l)  =SERS  (7) 
R7  (2)  =SERS  (8) 
R7  (3)  =SERS  (44) 
R7  (4)  =SERS  (45) 


97 


w 

Q 

B 

CO 

ffi 

U 

w 

g 

Pm 

CO 

§ 

O 

u 

CO 

g 

B 

U 

< 

(m 


o 

CN 

O 

B 

O 

O 


a 

Piq 


H 


o 

CN  CN 
CN 

O 
B 


o 

n 


H O 
B 

I— i 

(4  O 
Pm  C5 


O 

O 


H 


CO 

m 


c4 

Pm 


O 

CN 

O 

B 

O 

O 


H 


C4 

Pm 


CN 

O 

B 

O 

o 


o 

o 


S 

O 

w 


o 

CO 

O 

B 

O 

0 


a 

py 


H 

CN 

p4 

g 

CO 


CO 

CN 

o 

00 

B 

• 

<: 

f 

B 

CO 

• 

CO 

o 

P 

4 

in 

CN 

cn 

W 

■y 

a 

+ 

a 

O 

P 

B 

m 

4 

\ 

o 

a 

— 

' — ■ 

' — 

CD 

f — 1 

M 

s 

py 

4 

P 

P 

S 

r— 1 

p 

CO 

CO 

CO 

CO 

CO 

H 

• 

o 

« 

+ 

4 

+ 

P 

p 

4 

C4 

(4 

P4 

(4 

C4 

py 

1 — 1 

^ , 

Izi 

H 

S 

g 

4 

in 

P 

iH 

py 

py 

ly 

py 

py 

II 

H 

w 

H 

P 

o 

H 

p 

o 

W 

s 

in 

'll* 

X 

II 

H 

CO 

CO 

CO 

CO 

CO 

py 

o 

H 

— ' 

Q 

t — 1 

P 

CN 

' — ■ 

p 

CN 

P 

O 

in 

CN 

o 

H 

II 

II 

II 

II 

II 

pE! 

1! 

o 

r*H 

II 

r-H 

Pi 

X 

rH 

X 

P 

P 

II 

II 

II 

o 

CN 

, — , 

^ . 

, 

B 

S 

II 

O 

P:^ 

S 

ft; 

P 

II 

o 

P 

II 

O 

H 

P 

O 

. 

S 

II 

O 

in 

r— ^ 

CN 

CO 

o 

S 

CN 

* — 

o 

— 

2 

B 

£i 

s: 

B 

B 

3 

rM 

B 

rH 

o 

s 

CO 

' — ' 

' — 

V_-»' 

— 

py 

2; 

D 

p 

p 

P 

' — ' 

p 

p 

i> 

CO 

00 

CO 

00 

B 

py 

O 

Pn 

w 

P4 

P 

P 

O 

p 

p 

O 

O 

p 

P 

O 

D 

p 

p 

O 

Pm 

P4 

p4 

C4 

p4 

(4 

b 

P4 

p 

X 

Q 

H 

p 

H 

H 

X 

o 

H 

X 

CD 

U 

H 

P 

CD 

P 

p 

X 

P 

H 

S 

o 

u 

u 


CN 

CN 


O 

CN 


■H  ^ 
CN  CN 


DENOM=DENOM+ABS (FR2 (I) ) 


98 


o 

CN  n o 

fo  n r-l 


o 

m 

o 

o 

Eh 

o 

o 

Eh 

EH 

— . 

O 

1 — 1 

O 

H 

H 

EH 

•3« 

O 

o 

' — 

o 

' — ' 

, — . 

O 

CN 

o 

CM 

O 

, . 

Pi 

Pi 

O 

o 

, , 

o 

P 

2 

1 — 1 

• 

o 

*■ — ' 

^ ^ 

W 

• 

EH 

CO 

• 

o 

P 

a 

O 

P 

Eh 

m 

f 

\ 

w 

• 

c 

P 

w 

§ 

• 

+ 

« 

+ 

2 

P 

H 

s 

s 

« 

in 

2 

H 

p 

o 

H 

P 

o 

w 

'll* 

X 

' — ' 

CNJ 

X 

m 

' — ' 

2 

CO 

p 

O 

in 

n 

' — 

o 

r\s 

Pi 

X 

CNJ 

X 

2 

2 

II 

II 

II 

o 

Pi 

P 

II 

O 

Pi 

II 

O 

H 

W 

, — . 

O 

2 

II 

' — 

g 

Eh 

s 

Eh 

Eh 

Q 

CM 

EH 

CM 

O 

S 

p 

p 

2 

^ ' 

'■ — ■ 

2 

P 

P 

Cn 

o 

P 

21 

O 

O 

p4 

P 

O 

P 

W 

~z 

H 

H 

X 

o 

H 

X 

O 

U 

H 

P 

O 

P 

Q 

X 

CM 

o 

rM 

'd* 

CO 

n 

00 

cn 

o 

O 

Eh 

O 

O 


O 


W O 


« 

CM 

o 

h:)' 

H 

o 

' — ' 

H 

O 

EH 

, — V 

O 

> — . 

cn 

— ^ 

EH 



Eh 

Pi 

cn 

O 

H 

H 

• 

Pi 

O 

CD 

' — 

O 

" — ' 

Pi 

£i 

O 

cn 

CD 

ro 

O 

Pi 

O:^ 

• 

CP 

, 

O 

Pm 

00 

m 

1 — 1 

• 

' — 

o 

• 

< 

• 

CO 

• 

CO 

a 

+ 

a 

o 

m 

EH 

cn 

<Ti 

w 

S 

w 

• 

<i 

P 

< 

% 

• 

o 

• 

+ 

• 

+ 

1—1 

2 

H 

2 

lo 

II 

H 

W 

H 

— ^ 

P o 

H 

H'—p— P 
rollroct;X  f^X  !3 
opc:s:pc;t=Hii  opiii  oh 

^-'O'-'^SEhPSEhH 
23  p ^ p 

0pMPPl2!0p200 

PhqhhXOhXOU 

CN  O 


IF  (DENOM.NE.O)  GO  TO  4 
PU(3) =555 
GO  TO  44 

41  PU ( 3 ) = (XNUM/DENOM)  *100 


99 


o 

in 

O 

Eh 

O 

O 


O 

VX) 

O 

E-i 

O 

O 


o o 

• • 

a a 


W 

O 

w 

o 

t 

ni 

in 

o 

• 

CM 

CD 

o 

in 

in 

1 — 1 

CD 

p 

i-H 

H 

O 

in 

O 

H 

o 

VD 

o 

— ' 

H 

O 

Eh 

^ — 

O 

O 

^ — 

H 

o 

B 

^ — . 

O 

. , 

o 

' — 

EH 

, — , 

B 

O 

1— ^ 

in 

• — • 

B 

^ — . 

B 

o 

iH 

o 

H 

H 

B 

* 

P 

in 

O 

H 

H 

B 

* 

• 

Pi 

O 

O 

— ' 

O 

, , 

• 

P 

O 

C5 

' — 

O 

' — ' 

, , 

Pi 

P 

O 

O 

'4' 

O 

g 

P 

•&. 

O 

in 

CP 

IT) 

O 

g 

O 

— 

P 

p 

C5 

o 

O 

P 

P 

CP 

o 

• 

to 

o 

P 

p 

g 

• 

p 

O 

& 

g 

ro 

m 

rH 

t 

' — 

o 

'■ — ' 

, — , 

w 

m 

m 

t — 1 

• 

o 

, — . 

p 

« 

« 

Eh 

CO 

t 

CO 

O 

p 

• 

c 

« 

B 

p 

• 

P 

o 

p 

a 

+ 

a 

O 

m 

B 

m 

• 

\ 

a 

+ 

a 

O 

m 

B 

m 

« 

\ 

00 

w 

s 

w 

« 

P 

rtj 

w 

g 

m 

p 

g 

p 

• 

P 

< 

p 

g 

• 

o 

« 

+ 

t 

+ 

g 

p 

« 

o 

• 

+ 

• 

+ 

g 

p 

r— 1 

H 

s 

g 

• 

in 

g 

r—( 

g 

H 

g 

g 

t 

in 

g 

II 

H 

w 

H 

— 

p 

o 

H 

D 

o 

g 

in 

1! 

H 

p 

H 

— 

P 

o 

H 

p 

o 

g 

in 

'4* 

X 

H 

' — ' 

p 

" — 

g 

in 

g 

in 

P 

o 

in 

in 

o 

H 

p 

— ' 

in 

g 

p 

' — 

p 

P 

o 

m 

P 

II 

'=4’ 

Pi 

X 

X 

g 

g 

11 

II 

II 

O 

in 

¥ 

in 

P 

X 

P 

g 

g 

11 

II 

O 

g 

Pi 

P 

II 

O 

II 

O 

H 

p 

O 

, , 

g 

II 

O 

g 

S 

P 

II 

o 

P 

II 

o 

H 

p 

O 

in 

o 

— 

' — 

s 

Eh 

g 

B 

Ph 

p 

B 

o 

s 

CD 

O 

' — 

g 

B 

h 

g 

B 

Fh 

p 

in 

B 

p 

g 

'W' 

p 

fe 

5 

Iz; 

p 

2 

O 

w 

P 

P 

g 

O 

P-4 

g 

O 

O 

p 

p 

O 

p 

w 

[3 

o 

P4 

P 

P 

g 

O 

p 

O 

O 

p 

13 

O 

p 

P 

H 

p 

H 

H 

X 

o 

H 

X 

O 

u 

H 

p 

C5 

p 

p 

p 

H 

P 

H 

H 

X 

CP 

H 

CP 

u 

H 

P4 

CP 

p 

CN 

o 

1 — 1 

'4' 

CM 

o 

( — t 

in 

in 

in 

in 

KD 

CD 

p 

100 


o 

o 

Eh 

O 

a 


o 

00 

o 

EH 

o 

o 


a 


a 


W 

O 

p 

o 

• 

CN 

n- 

O 

• 

CN 

ro 

O 

, s 

p' 

i-H 

. 

CO 

00 

f— 1 

H 

, 

O 

o 

H 

o 

00 

N — ' 

H 

O 

EH 

, — , 

O 

o 

H 

o 

Eh 

, — . 

O 

ID 

— 

, 

Eh 

, — 

o 

rH 

r' 

— ' 

p 

EH 

o 

Pi 

ID 

O 

H 

H 

Eh 

¥ 

Pi 

O 

H 

H 

Eh 

• 

Pi 

o 

O 

— 

O 

' — '■ 

* 

P 

o 

O 

O 

— 

Pi 

h 

o 

ID 

ID 

ID 

O 

s 

Pi 

_P 

o 

n- 

o 

n- 

O 

o 

, — . 

Pi 

Pi 

O 

o 

O 

P 

P 

O 

• 

in 

o 

P 

P 

s 

• 

p 

o 

P 

— . 

P 

cn 

m 

« 

o 

' — ' 

p 

n 

m 

1—4 

• 

' — ' 

o 

' — 

. — ^ 

9 

• 

Eh 

in 

• 

CO 

O 

p 

• 

■ 

Eh 

P 

• 

in 

o 

a 

+ 

a 

O 

m 

EH 

m 

• 

\ 

a 

+ 

a 

C5 

m 

EH 

p 

• 

in 

w 

s 

w 

• 

< 

P 

C 

P 

s 

in 

p 

S 

p 

• 

P 

p 

• 

O 

t 

+ 

• 

+ 

P 

p 

• 

o 

• 

+ 

• 

+ 

p 

P 

H 

g 

2 

• 

in 

Pi 

.H 

p 

H 

s 

g 

• 

II 

H 

M 

H 

' — 

o 

H 

5 

o 

M 

S 

in 

X 

II 

H 

p 

H 

— 

p 

o 

H 

P 

o 

P 

S 

o 

H 

— ' 

P 

' — 

ID 

g 

— 

5 

O 

m 

o 

H 

' — ' 

p 

p 

00 

' — ' 

P 

00 

P 

o 

II 

O 

ID 

II 

ID 

Pi 

X 

ID 

X 

X 

P 

II 

II 

II 

o 

O' 

II 

Pi 

X 

X 

P 

p 

S 

II 

O 

S 

£i 

II 

O 

Pi 

II 

O 

H 

P 

O 

s 

II 

O 

B 

s 

P 

II 

O 

P 

II 

o 

H 

p 

o 

s 

1^ 

o 

g 

EH 

s: 

EH 

Fh 

B 

ID 

EH 

CD 

o 

g 

00 

o 

— 

g 

Eh 

P 

g 

EH 

p 

;2i 

p 

p 

p 

p 

' — ' 

'w'’ 

p 

P 

p 

p 

'■ — 

P 

P 

' — ' 

w 

p 

o 

P 

w 

P 

p 

p 

O 

p 

p 

O 

o 

p 

P 

O 

P 

p 

P 

o 

p 

p 

P 

p 

O 

P 

P 

O 

o 

p 

p 

X 

Q 

H 

p 

H 

H 

X 

O 

H 

X 

O 

u 

H 

P 

O 

P 

p 

X 

p 

H 

p 

H 

H 

X 

O 

H 

X 

O 

o 

H 

CN 

o 

r— 1 

CN 

o 

ID 

n- 

ro 

ra 

in 

in  ^ 
in  CO 
II 

--  O 
^2,  Eh 

D O 
CM  O 


81  PU  ( 7)  = (XNUM/DENOM)  *100 
84  DENOM=0 
XNUM=0 


101 


w 


w 

W 

u 

c 

w 

o 

Pm 

Pi 

O 

U 

D 

Pi 

&H 

CO 

13 


o 

<yl 

o 

F-! 

o 

o 


a 

w 


13 

W 

> 

H 

O 

w 

Q 


O 

w 

K 

H 


S 

Pi 

< 

i3 

g 


f 

CM 

CTl 

o 

<z 

O 

CTl 

on 

H 

H 

o 

CTl 

o 

P 

H 

O 

Em 

, 

O 

o 

CO 

3 

CO 

— ' 

Em 

Em 

— , 

o 

nH 

P 

ro 

00 

O 

H 

H 

EM 

* 

P 

§ 

<yi 

• 

p 

O 

O 

— ' 

O 

' — 

o 

M 

p 

p 

O 

00 

O 

00 

O 

a 

u 

P 

o 

o 

— 

, — 

P 

P 

o 

O 

p 

EM 

• 

CO 

o 

P 

, — , 

P 

3 

CN 

m 

P 

1 — 1 

• 

' — 

o 

P 

p 

, — , 

O 

• 

• 

Em 

CO 

* 

CO 

o 

P 

o 

c 

P 

O 

a 

+ 

a 

O 

p 

EM 

« 

• 

\ 

EM 

CO 

— ^ 

P 

p 

w 

• 

P 

M 

a 

U 

3 

P 

o 

• 

o 

• 

+ 

• 

+ 

3 

o 

< 

H 

r-M 

P 

p 

3 

rH 

3 

H 

g 

• 

in 

*z 

P 

II 

II 

P 

II 

• 

II 

H 

P 

H 

P O 

H 

pop 

q a 

m 

X 

, — , 

P 

P 

, — , 

H 

. — . 

a 

H 

P 

CO 

3 cr. 

3 cn  t 

0 O 

in 

(J\ 

ro 

H 

P 

P 

II 

u 

p 

o 

cn 


CD 
Pi  S 


O 
3 

O Cm  W 
Q H P 


00  ct; 
Pi  p 


Cm  P 
H H 


CO  X 
O Pi  II 
H P § 
D 

O P 3 
O H X 

CN 

CTi 


3 3 
O H cq 

EM  H P 

!Z  '**•'*' 
O O Cm 
CD  U H 

O 

CTi 


^ O ^ W 

00  Em  CO  cq 

v_-  ^ 

POP 

POP3 

U 


3 

H 
Em 
3 
O 
W U 


P 

P 


CTi 


P 


P 

o 

EM 

CO 


O' 

O 

P 


U U 
H H 


H 


(T> 


p 

CO 


U 

H 


Pop 
3 X H 


u u 


u 


GO  TO  99 

AVERAGE  EACH  PU(I)  EXCLUDING  555  (BLANK)  RESPONSES 
98  DO  152  J=l,8 


153  1=1+1 

IF  (SU(I,  J)  .EQ.555)  GOTO  157 


102 


CO 


> 

CD 

!3 

H 

CO 

CO 

H 

s: 

ce: 

o 

CO 


fO 
- Ln 
H r-t 

D O 

^ O — « 
bob 

s --  s 

D !g  b 

CO 
II 


C- 

i~H  b • 
+ ' 

X S 
II  b . . 

X CO  H 


CO 


X 

w 

§ 

o 

X 


H 


H 

b 

Ot 

w 

o 


CO 

w 

w 

> 

CO 

< 

Xi 

o 

o 

A) 

X 

CO 

H 

o 

W 

o 

Eh 

CD 

b 

r— 1 

in 

EH 

o 

r— 1 

H 

o 

a: 

o 

Eh 

EH 

w 

CO 

N 

EH 

o 

m 

O 

ro 

b 

O 

o 

O 

^ in 

CO 

X 

O 

H ■-) 

X n) 

H 

'■ — ' 

^ - H 

in 

Q 

— 

<;  o 

H S ' 

in 

b 

o 

K EH 

^ b X 

in 

b 

• 

o 

b X rH 

u 

a 

X o 

M b 

w 


H 


+ o ^ 


o 

II 


o 

II 

s 


CO 


o 


o 

EH  S 
b CO 
• II 
H 


^ ^ X CO  X 

tij  r-l  H - - . 

CJ  '~l  ^ rH 

X in  X II 

b ' rH  H 

CD 

EH 


Q W 
X EH 


CD 


I 1 ^ — V 

II  b 

b ' 

H 

O 

CD  b 
CO 


w 

§ 

b X 

' H 

H 




w 

w 

o 

o 

« 

o 

H 

■ — - 

X 

o 

X 

o 

C 

H X 

■ — ' 

X 

> 

o 

II 

II 

O 

S 

II 

X 

II 

s: 

X 

o 

II 

X o 

o 

O 

X 

b 

o 

H 

< 

g 

X 

H 

<c 

CO 

HI 

H 

X 

CO 

M 

< 

H 

is  X 

Q 

Q 

H 

CO 

u 

CN 

w 

O 

O 

H 

rH 

o 

in 

in 

> 

n 

X 

rH 

CD 

rH 

< 

in 

m 

X 

in 

rH 

1 — 1 

iX 

u 

u 

IF(XGRA(I)  .NE.O)  GO  TO  469 
XGRA(I)=AGRA 

469  WRITE  (7,501)  NU  (I)  , (SU  (I , J)  , J=1 , 8)  ,XGRA  (I) 
501  FORMAT (I4, IX, 8f7.1,3X,F4.0) 

161  WRITE  (6,500)  NU  (I)  , (SU  (I , J)  , J=1 , 8)  ,XGRA  (I) 


103 


o 

* ^ 

X 

m rH 

rH  O 

• H 

O 

CO  o 


X 


'd* 

H 

X 


|g 

CO 

CO 

c 

CJ  cri 

• o 

a -H 

w 

• o 

X EH 


S + X EH 

S X o . . 

O II  O Fh 

X X H C5  CO  W 


O 

o 

in 


V£> 


PROGRAM  NAME  = PCEI 

PUNCH  "FORM  A"  GENERAL  RATING  AND  TOTAL  OF  11  SPECIFIC  RATINGS 
DIMENSION  ID(50,7)  ,SR(50,12)  ,SUM(12)  ,AVE(12)  ,X(12) 


104 


X 

VD 

% 

O 

rH 

>< 

KD 


H 
CN  X 

r-i  f-H 


II  H 

b ' 
‘ X 

rH 

b ^ 

^ rH 

H H 

Pi  X 
CO  tH 

••  iH 

^ H 


X 


CN 

r- 

O 

H 

O 

r.n 


a 

W 


CM 

H 


CO 

O 

O 

O 


CD 

• 

a 

w 


CO 

H 


II 

o 

— 

- — 

b 

CM 

Pi 

Pi 



H 

rH 

CO 

CM 

CO 

CO 

% 

O 

« 

• 

b 

>c 

O 

H 

Pi 

H 

Pi 

H 

K 

rH 

iH 

o 

CM 

o 

— ■' 



H 

V 

cd 

' — ' 

« 

Pi 

— ' 

• 

Pi 

CM 

iH 

1 — ! 

cn 

X 

fH 

CO 

X 

iH 

CO 

S 

H 

Q 

H 

• 

+ 

\ 

« 

+ 

\ 

• 

+ 

5 

!3 

H 

CM 

Eh 

V. 

EH 

, — . 

Eh 

Si 

X 

— 

X 

fH 

P 

1 — I 

1 — I 

p 

p 

CM 

CM 

P 

CO 

rH 

fH 

K 

!3 

• 

fH 

' — ^ 

• 

1 1 

' — ' 

— ■ 

p 

• 

rH 

fH 

fH 

+ 

s 

s 

+ 

s 

g 

+ 

S 

CO 

rH 

iH 

II 

m 

II 

rH 

fH 

p 

p 

rH 

CM 

, — . 

p 

P 

iH 

CO 

P 

(N 

iH 

H 

H 

rH 

H 

b 

o 

o 

II 

iH 

CO 

m 

CO 

II 

CM 

CO 

M 

CO 

II 

cn 

CO 

1 — 1 

II 

V 

'w' 

5 

II 

II 

B 

H 

H 

II 

p 

II 

H 

H 

' — 

II 

P 

II 

H 

H 

II 

C' 

X 

in 

EH 

O 

in 

Eh 

s 

1 — 1 

o 

X 

— ' 

X 

P 

' — 

, — , 

P 

•* — ' 

^ — 

in 

CO 

'■ — ' 

O 

' — 

H 

CM 

b 

b 

II 

H 

rH 

Pi 

1! 

rH 

H 

rH 

CM 

Pi 

II 

CM 

H 

CM 

CO 

ro 

CO 

CO 

Q 

in 

Q 

ro 

■ — ' 

, — , 

Eh 

CO 

&H 

' — 

CO 

^ — 

' — 

Eh 

— 

O' 

— ' 

• 

< 

Pi 

< 

s 

w 

s: 

b 

13 

— 

iH 

S 

P 

w 

— ' 

CM 

s 

P 

w 

' — 

ro 

s 

II 

i-:i 

W 

o 

O 

W 

O 

o 

O 

> 

• — ' 

O 

O 

P 

— ^ 

P 

o 

> 

O 

p 

— 

p 

o 

> 

o 

Cn 

p 

U 

Pi 

Ch 

Q 

Pi 

Ph 

u 

P 

<c 

CO 

X 

u 

p 

H 

X 

CO 

u 

< 

Q 

H 

X 

CO 

u 

< 

Q 

H 

X 

CO 

O rH 


in  o 

rH  O 

in 


CM 

CO 


CM 


U U 


73  CONTINUE 


105 


in  vD 


cc 


o 

O 

O 

O 

O 

Eh 

EH 

EH 

Eh 

EH 

O 

O 

O 

O 

O 

C? 

0 

O 

O 

0 

ID 


ID 


a a 

w w 


ID 


a 

w 


yo 

• 

a 

w 

• 


VO 

• 

a 

w 


ID 

ID 

s 

H 

H 

H 

H 


00 

H 


0i 

Pi 

Pi 

Pi 

Pi 

^ ^ 

CO 

• 

W 

• 

in 

0 

0 

CO 

0 

0 



H 

Pi 

H 

H 



Pi 

H 

Pi 

H 

CO 

O 

' — 

O 

* — 

in 

O 

0 

O 

W' 

O 

' — 

0 

« 

Pi 

— 

• 

Pi 

• 

Pi 

•' — ■ 

« 

Ph 

V — 

« 

c3 

r”l 

CO 

X 

rH 

CO 

.X 

fH 

0 

X 

iH 

CO 

X 

iH 

0 

X 

\ 

• 

II 

\ 

• 

II 

\ 

• 

II 

\ 

» 

+ 

<V 

t 

+ 

C 

' 

Eh 

^ ^ 

^ ^ 

H 

^ — , 

Eh 



^ ^ 

Eh 

^ , 

Eh 

m 

hP 

Pi 

in 

in 

iJ 

0 

0 

P 

0 

0 

'' — 

12; 

• 

t — 1 

‘ — 

CTi 

!2; 

• 

I — 1 

CTi 

!2j 

• 

iH 

' — ' 

!zi 

1 1 

— ' 

[z; 

• 

rH 

2 

!l 

§ 

§ 

II 

g 

s 

X 

II 

g 

S 

II 

s 

X 

^ 

+ 

g 

s' 

5 

t-H 

N 

D 

D 

rH 

LT) 

D 

D 

1^ 

0 

, — . 

0 

fH 

s 

0 

r^ 

0 

p 

p 

cn 

II 

*■ 

CO 

CO 

II 

X 

in 

0 

M 

0 

II 

•. 

0 

0 

M 

0 

II 

X 

CO 

0 

II 

X 

0 

0 

M 

0 

II 

H 

H 

II 

5 

II 

H 

H 

II 

D 

II 

H 

H 

*' — 

1 

D 

II 

H 

H 

' — 

II 

s 

II 

H 

H 

— 

II 

P 

II 

— ^ 

X 

— , 

• — ' 

X 

S 

— 

X 

Iz; 

, . 

X 

P 

00 

'Ct' 

II 

H 

in 

II 

in 

H 

0 

0 

Pi 

II 

0 

H 

0 

Pi 

II 

r^ 

H 

0 

Pi 

IT 

0 

H 

S' 

CO 

' — 

Eh 

' — ' 

CO 

X. 

' — 

"■ — 

r-' 

0 

, — , 

' — 

Eh 

0 

w' 

tH 

' — 

0 

x_^ 

Eh 

' — 

W 

— ^ 

S 

t5 

w 

LO 

g 

g; 

W 

— ' 

0 

s 

w 

' — 

S 

w 

0 

s 

P 

w 

> 

O 

'W' 

D 

O 

> 

O 

Pm 

— ' 

o 

> 

O 

— 

0 

O 

v*^ 

O 

h 

— ^ 

o 

> 

O 

P 

' — 

P 

O 

> 

< 

Q 

H 

X 

CO 

0 

Q 

H 

X 

0 

u 

rt: 

Q 

H 

X 

0 

0 

c 

Q 

H 

X 

CO 

0 

< 

P 

H 

X 

0 

0 

in  ID  CO 

n- 


106 


X 


ro 

Pm 

X 


cn 

O 

Eh 

O 

O 


vD 

• 

a 

w 


o 

00 

o 

EH 

o 

o 


a 

Pi5 


CO 

o 

EH 

o 

o 


a 

w 


CN 

00 

o 

EH 

O 

O 


CD 

a 

pfl 


CN 


CN 


H 

X 

I 1 

rH 

H 


II 

X 


H 

10 


rH 

H 

‘X 


H 

x' 


rH 

rH 

rH 

o 

K 

CTi 

V 

V 

CD 

rH 

H 

, — . 

H 

H 

1 1 

II 

CN 

H 

■— ' 

o 

' — 

rH 

' — 

CN 

P 

H 

' — 

Pi 

1 — i 

Pi 

rH 

Pi 

1 — 1 

o 

» 

pc: 

CO 

CO 

CO 

Eh 

X 

CO 

cn 

• 

H 

o 

• 

H 

rH 

• 

H 

CN 

P 

rH 

• 

Pi 

— ' 

t — 1 

Pi 

rH 

Pi 

' — ^ 

rH 

O 

«. 

Pi 

H 

y — V 

o 

Pi 

'* — 

o 

o 

o: 

V— ✓ 

o 

H 

rH 

o 

' — 

CTi 

• 

CO 

X 

• 

CO 

X 

• 

CO 

X 

' — 

H 

• 

Pi 

■ — 

rH 

+ 

\ 

1 — 1 

+ 

\ 

1 — 1 

+ 

\ 

. — V 

P 

I — 1 

CO 

X 

f 

• 

• 

o 

H 

X 

• 

+ 

\ 

Eh 

o 

o 

p 

rH 

rH 

EH 

CN 

CN 

• 

, — . 

* — 

1 — 1 

Eh 

P 

I — 1 

1 — 1 

r^ 

p 

t — 1 

rH 

rH 

P 

1 — 1 

rH 

rH 

CN 

p 

p 

«i 

P 

cn 

cn 

• 

+ 

• — 

• 

+ 

w 

• 

+ 

— ’ 

Z 

1 — I 

o 

' — ' 



z 

• 

I — 1 

' — 

— ' 

Z 

, — . 

s 

g 

z 

S 

g 

z 

§ 

s 

• 

w 

cn 

H 

+ 

S 

Z 

O 

o 

p 

5 

rH 

rH 

P 

5 

CN 

CN 

P 

p 

rH 

rH 

> 

1 — 1 

1 — 1 

(T» 

. , 

P 

P 

c — 1 

rH 

rH 

CO 

CO 

rH 

1 — ! 

rH 

CO 

CO 

rH 

I — 1 

fH 

CO 

CO 

II 

II 

b 

c 

(N 

X 

II 

cn 

CO 

p CO 

II 

K 

II 

^ il 

II 

— 

II 

W II 

II 

II 

M 

II 

H 

P 

II 

rH  K 

1 — 1 

H 

H 

— ' 

II 

p II 

H 

H 

X 

, , 

b ^ 

H 

H 

X 

, 

JD  

H 

H 

X 

P 

H 

P ID 

X 



Z — 

II 

o 

13  o 

II 

rH 

12}  rH 

— 

II 

CN 

Z 

CN 

in 

o 

— ^ 

p 

Z 

CTc  fr;  II  CT^  H CTi 


CO  — Eh 

CTc  S J3 

O Pm  '-'  !=>  O 

Q H X CO  U 

o\ 

!> 


O ^ 
CO  CO  O 
rH 

O Pm 
P H X 


I — I H I — I I — 10^  ^ — ' 
H CO  CO  rH 

S Z W >-H 

PO>OP-- 
CO  U < Q H X 

o 

00 


rHHrHCNpi^rHHrH(NCD(v;  'HWr<  • 
'-^Fh'-'OOCOCN—  Pn'-'nHrHCO  HEhEhSCO 
s:zw  '--rHs:aw  — '---XHpcifu 

po>op-^po>oopct:opiOrH 

COUCQHXCOUCPQHCOUgprH 

O rH 

rH  CN  on 

CO  00  CD  rH 

iH  CN 


107 


n 

P4 


X 


ro 

Pm 

X 

VD 


CN  H 

I— I ^ 

' X 


rH 

^ H 

b X 

^ i-H 

H ' 
rH 
Pli  H 
CO  ' 

^ X 

•»  I — I 
r^  rH 

H 


1 — 1 

o 

o 

o 

o 

o 

o 

o 

o 

II 

X 

CM 

m 

m 

CD 

00 

(71 

b 

r-H 

O 

O 

o 

O 

o 

O 

o 

o 

(N 

Eh 

EH 

Eh 

EH 

Eh 

EH 

Eh 

Eh 

b 

H 

K 

O 

O 

O 

O 

O 

O 

O 

O 

H 

X 

!3 

CM 

O 

O 

O 

o 

O 

O 

O 

O 

— 

rH 

H 

Q 

s 

y — . 

. — V 

H 

rH 

5 

X 

i£) 

\D 

CD 

KO 

CD 

VD 

in 

' — 

H 

I — 1 

« 

IS 

• 

• 

• 

• 

• 

• 

« 

S> 

a 

* 

a 

a 

o 

a 

a 

a 

a 



X 

pp| 

w 

M 

H 

w 

p 

p 

p 

1 — 1 

H 

!3 

• 

CM 

• 

, — , 

• 

• 

^ — . 

• 

• 

^ 

• 



« 

-• — ^ 

CM 

in 

% 

m 

in 

CD 

CO 

H. 

1 — 1 

rH 

X 

rH 

CM 

H 

cn 

V 

s 

in 

CD 

•> 

r- 

ra 

P 

» 

H 

1 — 1 

II 

— ' 

H 

H 

•. 

H 

•• 

H 

H 

*. 

H 

H 

H 

' — 

b 

CD 

' — ^ 

H 

H 

OH 

H 

' — 

H 

' — 

H 

' — ' 

H 

— ^ 

H 

' — 

H 

' — ' 

H 

' — ' 

Eh 

Iz; 

• — - 

Eh 

' — 

CO 

— 

Cd 

— ' 

0^ 

'“H 

Pi 

• — 

Pi 

^ — ' 

Pi 

' — 

Pi 

Pi 

H 

PP| 

LO 

Oh 

1 1 

' — ■ 

Pi 

rH 

CO 

Pi 

1 — ! 

CO 

Pi 

rH 

CO 

Oh 

iH 

CO 

•H 

CO 

Pi 

rH 

P 

Pi 

rH 

P 

S 

Eh 

S 

m 

CO 

+ 

-f 

CO 

-E 

+ 

CO 

+ 

-f- 

CO 

+ 

-f 

CO 

-f 

-E 

CO 

-E 

-E 

P 

-E 

-E 

P 

+ 

H- 

H 

pt; 

H 

o 

o 

H— ' 

P 

CO 

V ' 

P 

CO 

— ■ 

p 

co 

— ' 

P 

CO 

— 

p 

co 

" — 

P 

CO 

P 

P 

■ ' 

P 

P 

o 

o 

pH 

O 

O 

II 

II 

Pm 

II 

II 

p 

11 

II 

Pm 

11 

II 

p 

II 

II 

p 

II 

II 

Pm 

II 

II 

Pm 

II 

II 

P 

II 

II 

Pm 

u 

Pm 

Q 

Q 

CO 

H 

Q 

CO 

H 

P 

CO 

H 

p 

CO 

H 

P 

CO 

H 

p 

CO 

H 

P 

CO 

H 

P 

P 

H 

P 

P 

in 

O 

O 

O 

O 

O 

O 

O 

CM 

CM 

in 

CM 

cn 

Mf 

in 

VD 

O' 

O 

r-H 

rH 

1 — 1 

ra 

108 


m 

• 

cri 

P 

in 

• 

X! 

0^ 

ro 

P4 

% 

O 

X 

• 

n 

- 

Pm 

o 

K 

• 

X 

CD 

P 

H 

V. 

rH 

X 

H 

CD 

X 

r— 1 

i“H 

H 

V 

1— i 

X 

H 

r~l 

V 

X 

1— 1 

rH 

H 

«. 

X ' 

1 — 1 

- X 

H 

^ fH 

I— I r I ^ 
H .H  H H 

Ci  rH  Pi  X 

CO  H 10  r^ 


^ ^ ^ K 


o 

o 

o 

X 

rH 

o 

P^ 

rs 

H 

i-H 

1— 1 

1 — 1 

«> 

O 

i— I 

CN 

X 

ro 

o 

O 

O 

II 

H 

II 

r— 1 

1 — 1 

EH 

EH 

EH 

b 

•. 

b 

X 

*. 

nj 

o 

O 

O 

O 

rH 

H 

EH 

O 

O 

O 

b 

«» 

b 

1— H 

% 

X 

O 

H 

H 

H 

rH 

^ CD 

• IS  • IS  • Q X P --I 


a 

* 

a 

* 

a 

H 

rH 

H 

H 

X 

w 

^ ^ 

w 

^ ^ 

p 

' — • 

% 

' — ' 

p 

« 

o 

• 

rH 

• 

X 

in 

t — 1 

1 — 1 

CM 

. — . 

H 

^ — 

rH 

< 

o 

•» 

I — 1 

<• 

(N 

I — 1 

■vf 

P 

fM 

H 

rH 

H 

rH 

IT) 

X 

Nf 

u 

' — 

% 

H 

rH 

H 

p 

• 

O 

H 

P 

H 

P 

H 

— ' 

CD 

' — 

p 

a 

P 

— ' 

CO 

— ' 

CO 

*• — 

P 

— 

H 

' — 

Eh 

p 

p 

Di 

rH 

— ^ 

P 

1 — I 

' — 

r-t 

in 

P 

P 

P 

<c 

H 

r-H 

• 

o 

CO 

+ 

+ 

CO 

+ 

+ 

CO 

+ 

+ 

\ 

tH 

S 

tn 

Eh 

+ 

X 

Eh 

P 

V.^ 

Q 

CO 

— ■ 

p 

CO 

— ■ 

P 

in 

in 

H 

P 

H 

P 

X 

X 

' — 

O 

O 

p 

Ti 

II 

p 

II 

II 

(H 

II 

II 

II 

p; 

o 

P 

o 

O 

1 

X 

p 

P 

H 

P 

CO 

H 

p 

CO 

H 

P 

in 

!>h 

2 

p 

p 

U 

H 

C5 

P 

O 

O 

O 

o 

'd- 

in 

o 

cn 

o 

rH 

CN 

in 

in 

p 

APPENDIX  F 


WRITTEN  INSTRUCTIONS  GIVEN  TO  STUDENTS 
ON  FIRST  DAY  OF  DATA  COLLECTION 


110 


INSTRUCTIONS 


I am  a student  in  educational  psychology  and  I am  trying  to 
develop  a questionnaire  which  will  measure  students ' ex- 
pectations for  their  instructor's  behavior.  I have  your 
instructor's  permission  to  use  these  next  few  minutes  of 
class  time  during  which  I will  ask  you  to  respond  to  my 
questionnaire . 

In  the  upper  right  hand  corner  of  each  questionnaire  there 
are  two  blank  lines.  On  the  top  one,  please  write  any  num- 
ber, name,  or  word  which  you  will  be  likely  to  remember.  I 
am  requesting  that  you  use  this  mark  because  I will  return 
one  day  around  the  end  of  the  quarter  at  which  time  I wi]l 
ask  you  to  identify  your  questionnaire.  With  your  help  I 
will  be  able  to  separate  out  the  questionnaires  of  those 
students  v^ho  have  dropped  the  course.  On  the  second  blank 
line,  please  write  your  instructor's  last  name  (this  in- 
formation will  help  me  to  keep  your  questionnaire  grouped 
with  the  questionnaires  of  the  other  students  in  your  class) . 

please  follow  the  instructions  at  the  top  of  the  question- 
naire and  be  sure  to  respond  to  each  question. 

Also  please  understand  that  this  questionnaire  has  nothing 
to  do  with  the  content  of  this  course  or  your  grade  in  this 
course.  The  results  will  not  be  shown  to  your  instructor  or, 
for  that  matter,  tabulated  until  well  after  the  end  of  this 
quarter . 

If  you  have  not  completed  the  questionnaire  in  the  10  or  so 
minutes  that  I am  here,  please  continue  immediately  and  try 
to  finish  it  before  you  form  any  impression  of  your  instruc- 
tor. You  can  then  turn  the  completed  questionnaire  in  to 
your  instructor  at  the  end  of  the  class  and  he  will  forward 
it  to  me. 

If  you  have  any  questions  regarding  these  instructions,  please 
feel  free  to  ask  them.  If  you  would  like  to  know  some  of  the 
details  of  my  work  and  the  development  of  this  questionnaire, 

I will  be  happy  to  answer  your  questions  when  I return  at  the 
end  of  the  quarter. 

Thank  you  very  much  for  your  cooperation. 
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PROCTOR'S  DIRECTIONS  FOR  ADMINISTRATION 


A.  Sort  through  the  Student  Expectation  Questionnaires 
making  sure  that  everyone  who  filled  one  out  recognizes 
and  knows  his  identification  mark.  At  the  end  of  the 
sorting,  ask  those  who  did  not  recognize  their  mark  to 
sort  through  the  remaining  papers  and  to  try  to  identify 
their  own. 

B.  Teacher  Behavior  Questionnaires 

1.  Hand  out  the  Teacher  Behavior  Questionnaire  (TBQ) 
to  everyone  who  filled  out  the  Student  Expecta- 
tion Questionnaire,  and  instruct  them  to  put  the 
same  identification  mark  on  their  new  instrument. 

2.  Ask  students  filling  out  the  TBQ  to  read  the 
instructions  and  answer  all  the  items. 

3.  Make  it  clear  that  their  responses  will  in  no  way 
affect  their  grade  in  the  course  (the  data  won't 
even  be  analyzed  until  next  quarter) . 

C.  Remaining  Students 

1.  Tell  the  remaining  students  that  you  are  handing 
out  copies  of  the  two  College  of  Education  teacher 
evaluation  instruments  and  that  there  are  tv/o  sets 
of  instructions  and  two  answer  sheets . 

2.  Make  it  clear  that  these  are  the  forms  ordinarily 
required  of  their  instructor  and  that  they  will 
aid  him  in  improving  the  course. 

3.  Tell  them  to  be  sure  to  put  the  instructor's  name 
on  both  answer  sheets  but  to  not  sign  their  own 
name.  Also  warn  everyone  that  there  are  some  sets 
of  instructions  which  wrongly  direct  students  to 
leave  off  the  instructor's  name. 

4.  Hand  out  the  student  evaluation  of  teaching  forms 
with  the  short  note  attached. 

5.  Ask  students  to  return  the  instructions,  the  answer 
sheets,  and  the  notes  paper  clipped  together. 

D.  Additional  instructions  to  TBQ  students 

1.  Tell  the  students  working  on  the  TBQ  to  bring  the 
completed  instrument  forward  for  more  instructions 
when  they  are  finished. 

2.  When  students  finishing  the  TBQ  do  come  forward, 
collect  their  completed  instruments  and  give  them 
the  student  evaluation  of  teaching  instruments  with 
the  long  note  attached. 
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3 . After  everyone  has  begun  work  on  the  student 

evaluation  of  teaching  instrument  announce  that: 

a.  (once  again)  Everyone  should  return  all  forms 
and  the  note  clipped  together. 

b.  Everyone  who  filled  out  the  TBQ  should  put 
their  identification  mark  on  the  two  answer 
sheets  because  otherwise  their  responses 
will  be  of  no  help  to  this  research  project. 

E.  Try  to  check  on  the  identification  marks  when  the  forms 
with  the  long  notes  are  returned.  But,  if  individuals 
don't  want  to  mark  their  answer  sheets,  don't  press 
them. 

F.  When  all  instruments  have  been  returned  be  prepared  to 
answer  the  questions  that  anyone  might  have  regarding 
the  purpose  of  the  research. 

Anyone  coming  late  should  be  asked  if  they  filled  out  a 
Student  Expectation  Questionnaire  at  the  beginning  of  the 
quarter.  If  they  did,  find  it  and  make  sure  that  they  know 
their  identification  mark.  Then  give  them  a Teacher  Be- 
havior Questionnaire  with  the  proper  verbal  instructions. 

If  they  did  not  fill  out  a Student  Expectation  Questionnaire, 
give  them  the  two  teacher  evaluation  instruments  and  the 
appropriate  note. 


APPENDIX  H 


INSTRUCTION  NOTES  NUMBERS  1 AND  2 
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NOTE  NUMBER  1 


These  forms  are  self  explanatory.  Please  respond  fully  to 
both  of  them,  and  write  only  on  the  answer  sheets.  You  are 
free  to  leave  when  you  finish. 

Please  leave  the  completed  forms  at  the  front  of  the  room 
when  you  depart. 

Thanks  for  your  cooperation 


NOTE  NUMBER  2 


These  forms  are  self  explanatory.  Please  respond  fully  to 
both  of  them,  and  write  only  on  the  answer  sheets. 

As  a part  of  the  research  being  done  v/ith  the  tv/o  question- 
naires you  have  already  filled  out,  you  are  asked  to  write 
the  same  identification  mark  used  on  these  previous  instru- 
ments in  the  upper  right  hand  corner  of  the  present  two 
answer  sheets . 

Be  assured  that  this  data  cannot  be  traced  to  you  and  that 
it  will,  in  no  way,  affect  your  grade  in  this  class. 

Please  leave  the  completed  forms  at  the  front  of  the  room 
when  you  depart . 

You  are  free  to  leave  when  you  are  finished.  However,  if 
you  would  like  to  learn  about  the  purpose  of  this  research, 

I will  be  available  for  questions  when  everyone  is  finished. 


Thanks  very  much  for  your  cooperation 


APPENDIX  I 


BROWN'S  REGRESSED  GAIN  PROGP-AM 


REGRESSED  GAIN  PROGRAM 1970  VERSION WRITTEN  FOR  FT- 
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26-30  AND  ETC.  NO.  OF  SUBJECTS  IN  SUBSEQUENT  GROUPS  IN 
15  FIELDS. ■ EIGHT  IS  THE  MAXIMUM  NO  OF  GROUPS. 

69  NICR  INCREMENT  FOR  CARD  COUNT  IN  SET  , II 

LETS  YOU  NUMBER  CARDS  UNIQUELY  FROM  SEVERAL  RUNS 
SO  THAT  YOU  CAN  SORT  THEM  TOGETHER  OR  MERGE. 
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APPENDIX  J 


MEANS  AND  STANDARD  DEVIATIONS  FOR  ALL  RAW  SCORES 
CLASSIFIED  AS  TO  COLLEGE  STANDING,  UNDERGRADUATE 
G.P.A,,  ESTIMATE  OF  CURRENT  GRADE,  COLLEGE  OF 
ENROLLMENT,  REASON  FOR  TAKING  COURSE,  PREVIOUS 
COURSE  WORK  WITH  INSTRUCTOR,  AND  KNOWLEDGE 
OF  INSTRUCTOR'S  METHODS 
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